Of Notes

Probability Theory

2 min read · revised 17 October 2026 · referred to by 4 notes · ·

If some specific outcome occurs a number of times in attempts, then its observed probability is .

More generally we have some random variable which we want to know the probability of:

Probability Densities

Instead of treating discrete sets of events we might also talk about continuous probabilities.

If some variable is governed by probability for falling into some interval we call that the probability density for . And the probability that lies in is given by:

where must satisfy that and .

Above when we say we are approximating the expression:

Change of Variables

Sometimes when we want to change the units of a variable such as height which would be measured in meters we measure in a new variable of centimeters:

therefore:

Now we consider an arbitrary transformation (we describe the old variable in terms of the new one).

We are mapping the old space in terms of the new space using . We want to satisfy that:

\(g\) carries a strip of width \(\delta y\) onto one of width \(\delta x \approx g'(y)\,\delta y\). Both hold the same probability, so the density has to rescale by \(\vert g'(y) \vert\).
Fig. 1. carries a strip of width onto one of width . Both hold the same probability, so the density has to rescale by .

And from calculus we know that:

Which we can plug back into the probability density equation:

so finally:

Where we take the absolute value of the derivative since we are only interested in the magnitude of the change in units - aka the Jacobian of the transformation.

/ or Ctrl K
search; empty, it shows notes to revise and lately read
m
mark this note to revise, or unmark it
c
cover maths, proofs and solutions to test yourself
n
uncover the next covered item
y
copy this note’s org-roam link
e
copy this note as markdown, LaTeX kept as TeX
p
the next problem to work; there h hints, s shows the solution, x passes it for today
→ ← j k space
turn the page, when reading in pages
l
on the map, trace the greatest distance, then the longest path
double-click
a formula, to copy its TeX
rest on maths
bind a part of a formula and open the wheel of notes it comes from; scroll or ↑ ↓ widens it, 1–6 goes
?
this card