Search for probability and statistics terms on Statlect
StatLect

Sample mean

by , PhD

The sample mean is a statistic obtained by calculating the arithmetic average of the values of a variable in a sample.

If the sample is drawn from probability distributions having a common expected value, then the sample mean is an estimator of that expected value.

Table of Contents

Definition

A more precise definition follows.

Definition Let [eq1] be the observed values of a variable. Their sample mean, denoted by $overline{x}_{n}$, is[eq2]

The sample mean is a fundamental quantity in statistics. Its properties are discussed in the next sections.

The sampling distribution

In order to analyze the properties of the sample mean, we assume that [eq3] are the realizations of n random variables [eq4].

We use the term sample mean also when we refer to the random variable[eq5]

In other words, before the realizations of the random variables [eq6] become known, their sample mean can be regarded as a random variable.

The probability distribution of Xbar_n is called the sampling distribution of the sample mean.

Population mean

If [eq7] all have the same expected value [eq8]then mu is called the population mean.

The sample mean as an estimator

When the population mean mu is unknown, the realization $overline{x}_{n} $ is an estimate of mu, while the random variable Xbar_n is an estimator of mu (remember that an estimator is a pre-defined rule that associates an estimate to each possible sample we can observe).

Expected value

The first important property of the sample mean is that it is an unbiased estimator of the population mean:[eq9]

Variance

Suppose that the random variables [eq10] are independent and have a common finite variance [eq11]

Then, the variance of the sample mean is[eq12]

Law of large numbers

Under appropriate conditions, the sample mean converges (in probability or almost surely) to the population mean.

This fundamental result is known as Law of Large Numbers.

Consistent estimator

When the estimator of a parameter converges to the true value of the parameter, we say that it is consistent.

Therefore, if a law of large numbers applies, the sample mean is a consistent estimator of the population mean.

Central limit theorem

Under appropriate conditions, the random variable[eq13] converges in distribution to a standard normal distribution (i.e., a normal distribution with zero mean and unit variance).

This is another fundamental result, known as Central Limit Theorem.

Asymptotically normal estimator

When a central limit theorem applies, and the statistic[eq14]converges to a normal distribution, we say that the sample mean is asymptotically normal.

Exact distribution

If the random variables [eq10] are independent normal random variables, then also the sample mean has a normal distribution.

This is discussed in the lecture on mean estimation.

Maximum likelihood estimator

In many important cases, the sample mean coincides with the maximum likelihood estimator (MLE) of the population mean. See, for example:

More details

Want to know more about the sample mean? See how it is used to:

Keep reading the glossary

Previous entry: Robust standard errors

Next entry: Sample point

How to cite

Please cite as:

Taboga, Marco (2021). "Sample mean", Lectures on probability theory and mathematical statistics. Kindle Direct Publishing. Online appendix. https://www.statlect.com/glossary/sample-mean.

The books

Most of the learning materials found on this website are now available in a traditional textbook format.