Of Notes

Conjugate Prior

1 min read · revised 11 October 2026 · referred to by 2 notes · ·

Table of Contents

A conjugate prior is a probability distribution chosen such that a posterior probability belongs to the same family as the prior distribution.

Suppose we have a likelihood which follows the Bernoulli Distribution of something like a coin toss:

We now want to pick a prior that will make the product with this distribution easy to later normalize or analyze. For this case we might pick a Beta Distribution for .

When we combine these two distribution to achieve our posterior distribution they merge quite nicely:

Which we finally express with all the dependent parameters:

Example Conjugate Priors

Likelihood Unknown parameter Conjugate Prior
Bernoulli success probability Beta
Binomial success probability Beta
Categorical / Multinomial category probabilities Dirichlet
Poisson rate Gamma
Exponential rate Gamma
Geometric success probability Beta
Negative binomial success probability Beta
Gaussian (known variance) mean Gaussian
Gaussian (known mean) precision Gamma
Gaussian (known mean) variance Inverse-Gamma
Gaussian (both unknown) mean and precision Normal-Gamma
Multivariate Gaussian (known covariance) mean vector Gaussian
Multivariate Gaussian (known mean) covariance matrix Inverse-Wishart
Uniform upper bound Pareto
/ or Ctrl K
search; empty, it shows notes to revise and lately read
m
mark this note to revise, or unmark it
c
cover maths, proofs and solutions to test yourself
n
uncover the next covered item
y
copy this note’s org-roam link
e
copy this note as markdown, LaTeX kept as TeX
p
the next problem to work; there h hints, s shows the solution, x passes it for today
→ ← j k space
turn the page, when reading in pages
l
on the map, trace the greatest distance, then the longest path
double-click
a formula, to copy its TeX
rest on maths
bind a part of a formula and open the wheel of notes it comes from; scroll or ↑ ↓ widens it, 1–6 goes
?
this card