Elements of Statistical Learning
Problem Sheet 2
1.Symmetric Bernoulli: normalisation, mean, variance, entropysolution
For
the Bernoulli distribution can be written Show that it is normalised and evaluate its mean, variance and entropy.2.Normalisation of the binomial distributionsolution
Prove, for integer
and real , the binomial theorem by induction: (a) show it for ; (b) show that ; (c) use (a), (b) to prove that if it holds for it holds for ; (d) show that and hence that is normalised.3.Mean and variance of the binomial distributionsolution
Show that the binomial distribution has mean
and variance . (a) Differentiate with respect to and rearrange for the mean. (b) Differentiate twice and use the result for the mean to obtain the variance.4.Normalisation of the beta distributionsolution
Starting from
, show that Steps: (a) bring the $y$-integral inside the $x$-integrand; (b) substitute with fixed; (c) swap the order of the and integrations; (d) substitute with fixed.
Solutions
1.Symmetric Bernoulli: normalisation, mean, variance, entropy
No solution yet.
2.Normalisation of the binomial distribution
No solution yet.
3.Mean and variance of the binomial distribution
No solution yet.
4.Normalisation of the beta distribution
No solution yet.