Of Notes

Gaussian Distribution

1 min read · revised 23 October 2026 · referred to by 5 notes · ·

A Gaussian expression starts with a term which is wrapped with an such that a general Gaussian term looks like:

Where any multiplier of the squared term will determine the general slopes around the center while any added term multiplied by adjusts the shift of the distribution.

A globally fundamental distribution that depends on and is given by (named for Carl Friedrich Gauss):

Where the general form we can notice is as follows:

  • The fraction in the front is a normalizing factor
  • The difference between and is the main penalty scaled by the denominator.
  • The main bellcurve shape comes from the term.

We also call the precision.

Why does the distribution have the exponential component in the first place?

When we maximize entropy you create a term of which once solved yields:

Maximum Likelihood Estimation

Imagine we have some data and we want to understand what kind of and could produce such a resulting dataset.

We start by taking the log:

Now we can derive with respect to … :

We can also then say that the maximum likelihood and are unbiased and biased respectively.

/ or Ctrl K
search; empty, it shows notes to revise and lately read
m
mark this note to revise, or unmark it
c
cover maths, proofs and solutions to test yourself
n
uncover the next covered item
y
copy this note’s org-roam link
e
copy this note as markdown, LaTeX kept as TeX
p
the next problem to work; there h hints, s shows the solution, x passes it for today
→ ← j k space
turn the page, when reading in pages
l
on the map, trace the greatest distance, then the longest path
double-click
a formula, to copy its TeX
rest on maths
bind a part of a formula and open the wheel of notes it comes from; scroll or ↑ ↓ widens it, 1–6 goes
?
this card