StatLect

Weak Law of Large Numbers

by Marco Taboga, PhD

A Weak Law of Large Numbers is a proposition stating a set of conditions guaranteeing that the mean of a sample converges in probability - as the sample size increases - to the true mean of the probability distribution from which the sample has been extracted.

The adjective weak is used because convergence in probability is often called weak convergence, and it is employed to make a distinction from Strong Laws of Large Numbers, in which the sample mean is required to converge almost surely.

Table of Contents

Acronyms

The acronym WLLN is frequently used as an abbreviation of Weak Law of Large Numbers.

Statement

A more precise definition follows.

Definition Let [eq1] be a sequence of random variables with mean [eq2]. Then, we say that a Weak Law of Large Numbers holds if and only if[eq3]where $\QTR{rm}{plim}$ denotes a limit in probability.

The conditions that need to be imposed on the sequence [eq4] in order to derive a Weak Law are usually quite mild. For example, in Chebyshev's WLLN, it is only required that [eq5] be covariance stationary and that auto-covariances between the terms of the sequence be on average equal to zero.

More details

The lecture entitled Laws of Large Numbers discusses Weak and Strong Laws in more detail. In particular, it provides precise statements and proofs of two versions of Chebyshev's WLLN.

Keep reading the glossary

Previous entry: Variance formula

The books

Most of the learning materials found on this website are now available in a traditional textbook format.