Type II errors and power
Studying this course? Keep your progress in one place.
Key facts
- A Type II error is not rejecting when it is false; its probability needs a stated true value.
- Use the distribution for the true parameter value, not the value.
- Power .
- Power rises when the true value is further from , or the sample is larger.
- Enlarging the critical region lowers (Type II) but raises (Type I).
Type II errors and their probability
Find the probability that the test statistic is outside the critical region, using the true parameter value.
A Type II error is failing to reject when is false.
To find its probability you need a specific true value of the parameter:
Use the distribution for the true value, not the value in . For a Type I error it is the other way round.
| H0 is true | H0 is false | |
|---|---|---|
| Reject H0 | Type I error | Correct (the power) |
| Do not reject H0 | Correct | Type II error |
H0 is true
- Reject H0:
- Type I error
- Do not reject H0:
- Correct
H0 is false
- Reject H0:
- Correct (the power)
- Do not reject H0:
- Type II error
Which distribution do you use to find the probability of a Type II error?
The power of a test
The probability of correctly rejecting a false , for a given true value.
The power of a test is the probability of rejecting when it is false:
Power depends on the true value, so a test has a different power for each possible alternative. High power means the test is good at detecting a real change.
- Power
- Power depends onthe true value
For a given true value, . What is the power?
Binomial and Poisson tests
Work out the non-rejection region, then use the distribution with the true parameter.
Binomial. , , , reject if . True : .
Poisson. , reject if . True : .
Write the distribution with the true parameter first. The non-rejection region is the complement of the critical region: take care with the boundary.
- p = 0.5
- p = 0.7
| Binomial | Poisson | |
|---|---|---|
| Test | H0: p = 0.5, reject X ≥ 8 | H0: λ = 5, reject Y ≥ 10 |
| True value | p = 0.7 | λ = 8 |
| P(Type II) | P(X ≤ 7) = 0.6172 | P(Y ≤ 9) = 0.7166 |
| Power | 0.3828 | 0.2834 |
Binomial
- Test:
- H0: p = 0.5, reject X ≥ 8
- True value:
- p = 0.7
- P(Type II):
- P(X ≤ 7) = 0.6172
- Power:
- 0.3828
Poisson
- Test:
- H0: λ = 5, reject Y ≥ 10
- True value:
- λ = 8
- P(Type II):
- P(Y ≤ 9) = 0.7166
- Power:
- 0.2834
Worked example
, , . The test rejects if . The true value is . Find (Type II error) and the power.
- 1
Use the true value: .
- 2
A Type II error means not rejecting, so .
- 3
from the cumulative tables.
- 4
Power .
A test rejects if . Which expression gives (Type II error)?
Normal tests
Use with the true mean, and find the probability of falling in the critical region.
For a test of a mean with known, with the true mean.
One-tailed: , , , , reject if . True mean : , so power .
Two-tailed: reject if or , true mean , sd : . This is the non-rejection region.
Worked example
, , standard deviation of equal to . Reject if . The true mean is . Find the power.
- 1
Use the true mean: .
- 2
Power is the probability of rejecting: .
- 3
, so .
In the example above, which region gives the Type II error?
What affects power
Power is higher for a true value further from , a larger sample or a larger critical region; the last also raises (Type I).
Power is higher when:
- the true value is further from the value;
- the sample size is larger, so has a smaller standard deviation;
- the critical region is larger, but this also raises the probability of a Type I error.
So there is a trade-off: enlarging the critical region lowers (Type II) but raises (Type I). Only a bigger sample can improve both.
What happens to the power of a test if the true value moves further from the H₀ value?
Try an exam question
A test of against uses and rejects if . The true value of is . Find the probability of a Type II error and the power of the test.
[4 marks]
- [1]Use the true value: .
- [1]A Type II error means not rejecting , so .
- [1].
- [1]Power .
That's the notes covered.
Carry on to the next subtopic.
Try a question
Find the probability of a Type II error when the true value is .
1 mark, marked against the mark scheme
Find the probability of a Type II error when the true value is .
1 mark, marked against the mark scheme