Jensens's inequality concerns the expected value of convex and concave transformations of a random variable.

Table of contents

The following is a formal statement of the inequality.

Proposition Let be an integrable random variable. Let be a convex function such thatis also integrable. Then, the following inequality, called Jensen's inequality, holds:

Proof

A function is convex if, for any point the graph of lies entirely above its tangent at the point :where is the slope of the tangent. Setting and , the inequality becomesTaking the expected value of both sides of the inequality and using the fact that the expected value operator preserves inequalities, we obtain

If the function is strictly convex and is not almost surely constant, then we have a strict inequality:

Proof

A function is strictly convex if, for any point the graph of lies entirely above its tangent at the point (and stricly so for points different from ):where is the slope of the tangent. Setting and , the inequality becomesand, of course, when . Taking the expected value of both sides of the inequality and using the fact that the expected value operator preserves inequalities, we obtainwhere the first inequality is strict because we have assumed that is not almost surely constant and therefore the eventdoes not have probability .

If the function is concave, then

Proof

If is concave, then is convex and by Jensen's inequality:Multiplying both sides by and using the linearity of the expected value we obtain the result.

If the function is strictly concave and is not almost surely constant, then

Proof

Similar to previous proof.

Suppose a strictly positive random variable has expected valueand it is not constant with probability one. What can we say about the expected value of , by using Jensen's inequality?

The natural logarithm is a strictly concave function, because its second derivative is strictly negative on its domain of definition.

As a consequence, by Jensen's inequality, we have

Therefore, has a strictly negative expected value.

Let be a strictly positive random variable, such thatWhat can you infer, using Jensen's inequality, about the following expected value:

Solution

The functionhas first derivativeand second derivativeThe second derivative is strictly negative on the domain of definition of the function. Therefore, the function is strictly concave. Furthermore, is not almost surely constant, because it has strictly positive variance. Hence, by Jensen's inequality:

The book

Most of the learning materials found on this website are now available in a traditional textbook format.

Featured pages

- Hypothesis testing
- Point estimation
- Delta method
- Beta distribution
- Bernoulli distribution
- Convergence in probability

Explore

Main sections

- Mathematical tools
- Fundamentals of probability
- Probability distributions
- Asymptotic theory
- Fundamentals of statistics
- Glossary

About

Glossary entries

- Probability density function
- Mean squared error
- Factorial
- Continuous random variable
- Loss function
- Convolutions

Share