The Central Limit Theorem
Studying this course? Keep your progress in one place.
Key facts
- For a large sample size , the sample mean is approximately normal: .
- It holds whatever the shape of the population; the sample mean, not the population, is the one that is normal.
- Find and for one observation first, then divide by .
- Standardise with ; is the standard error.
- For a smallest sample size, solve with the inverse normal and round up.
What the CLT says
For a large sample, the sample mean is approximately normal, whatever the population's shape.
The Central Limit Theorem (CLT) says that if a population has mean and variance , then for a large sample size the sample mean is approximately normally distributed.
This holds whatever the shape of the population distribution, so the population does not have to be normal. You can use it for Poisson, binomial, geometric and negative binomial populations. You do not need to prove it.
The larger is, the better the approximation; about or more is usually accepted as large. Saying the CLT makes the population normal is a common slip.
- Large
What does the Central Limit Theorem say is approximately normal?
Population mean and variance
Use the mean and variance of a single observation from the population, from the standard results.
To use the CLT you need and the population variance for a single observation. Use the standard results.
Be careful with the symbol . For a binomial population, in is the number of trials in one observation, whereas the CLT sample size is the number of observations.
Write down the population and before anything else, then divide by the sample size to get the variance of .
| Poisson Po(λ) | Binomial B(n, p) | Geometric Geo(p) | Negative binomial NB(r, p) | |
|---|---|---|---|---|
| Mean | ||||
| Variance |
Poisson Po(λ)
- Mean :
- Variance :
Binomial B(n, p)
- Mean :
- Variance :
Geometric Geo(p)
- Mean :
- Variance :
Negative binomial NB(r, p)
- Mean :
- Variance :
Worked example
A box holds pens, each faulty with probability . A sample of boxes is taken. State the approximate distribution of the sample mean number of faulty pens.
- 1
One box: .
- 2
and .
- 3
The sample size is boxes, so the variance of is .
For , what is ?
Probabilities for a sample mean
Find and , state the CLT distribution, standardise with the standard error and use the normal tables.
Follow these steps: find and of one observation; state and say the CLT is used because is large; standardise; read the probability from the normal distribution.
The standard error is , the standard deviation of . A sample mean varies far less than a single observation. For a mean within of : .
- 1
Population
Find and of one observation
- 2
State
, because is large
- 3
Standardise
- 4
Read
Use the normal distribution on your calculator
Worked example
and a sample of is taken. Find .
- 1
For , and .
- 2
By the CLT, .
- 3
Standardise: .
- 4
.
A population has and . What is the standard deviation of ?
Sample size and when CLT applies
Standardise with unknown, use the inverse normal and round up.
For the smallest so that a probability condition holds, standardise with unknown and use the inverse normal. Always round up to the next whole number.
To justify the CLT, state that the sample is large, so the sample mean is approximately normal even though the population is not. The approximation is poor for small when the population is very skewed, such as a geometric distribution with small . The observations must also be independent.
In an "explain" question, name the Central Limit Theorem and say why it applies.
Worked example
. Find the smallest such that .
- 1
and , so .
- 2
, so we need .
- 3
, so .
A solution gives . What sample size do you state?
Try an exam question
A random variable . A random sample of observations of is taken, with sample mean . Use the Central Limit Theorem to find .
[5 marks]
- [1] and .
- [1]By the CLT, since is large, .
- [1]Variance of is .
- [1].
- [1].
That's the notes covered.
Carry on to the next subtopic.
Try a question
Which of the following is the approximate distribution of ?
1 mark, marked against the mark scheme
Which of the following is the approximate distribution of ?
1 mark, marked against the mark scheme