Of Notes
Maximum Likelihood
Table of Contents
This is a form of Frequentist Statistical Inference of which the result might also be a Biased Estimator in certain cases.
The general idea is to take some observations (and finding parameters of a distribution to align the two) and constructing a joint distribution in shape of:
Which we take the log of:
And then optimize to find the maximum by doing:
Binary Distributions Case
We observe some dataset
We then define a likelihood of having observed this dataset
Now we have a function which can learn from our data and we can optimize over one parameter
And if the polynomial inside
This is however very naive and "over-fitted" since this model would predict that the only plausible future is heads.