The function is strictly convex if for all the graph of lies entirely above its tangent at . Mathematically:
The function is strictly convex iff its second derivative is non-negative. If in (6) the strict inequality is replaced by , the function is called convex (the graph may then have "flat" parts).
(i) Let be a real random variable. Verify that for any convex function the Jensen inequality holds:
Hint: let and be random variables such that (equivalently, is a non-negative random variable). As the expectation of a non-negative random variable is non-negative, it follows that : taking expectation preserves inequalities.
(ii) Let be a discrete random variable taking values with probabilities . Show that for any convex function
(iii) Let be any function such that is well defined for any . Show that for any real random variable
with the inequality being strict for a strictly convex function , unless is a constant.