In hypothesis testing, a Type II error occurs when the null hypothesis is not rejected even though it is false.

Type II errors are also referred to as **errors of the second
kind**.

When performing a test of hypothesis, a decision is made as to whether the
null hypothesis should be rejected or not. This choice is made on the basis of
a test statistic. When the value taken by
the statistic belongs to a critical region that has been specified in advance,
the null hypothesis is rejected. Otherwise, the null is not rejected. This
decision process is prone to the following kind of error: **do not
reject the null hypothesis when the null hypothesis is indeed false**.
Errors of this kind are dubbed Type II errors, in order to distinguish them
from Type I errors, which occur when the null hypothesis is rejected despite
being true.

The next tree plot provides a graphical illustration of the two types of error.

Earlier we have mentioned that the outcome of a test of hypothesis depends on the value assumed by a test statistic. In turn, this value depends on the data used to compute the statistic. But the data is random. Thus, before the data is observed, the test statistic can be regarded as a random variable. As a consequence, the probability that a Type II error occurs is equal to the probability that the realization of a random variable (the test statistic) will not belong to the critical region.

In several important cases, the probability of committing Type II errors can be exactly quantified through a function called power function.

Suppose you make an hypothesis about the variance of a probability distribution. In particular, your null hypothesis is that the variance of the distribution should be equal to 1. After formulating your hypothesis, you collect a sample of observations from the distribution, and, based on the sample variance, you do not reject the null hypothesis that the variance of the distribution is equal to 1. If instead the true (and unknown) variance of the distribution is not equal to 1 (for example, because it is equal to 2), then you are committing a Type II error.

A thorough discussion of Type II errors committed while performing tests of hypotheses about the variance can be found in the lecture entitled Hypothesis tests about the variance.

Go to the lecture entitled Hypothesis testing for more details about Type II errors.

Previous entry: Type I error

Next entry: Unadjusted sample variance

The book

Most learning materials found on this website are now available in a traditional textbook format.