Language of hypothesis testing
Studying this course? Keep your progress in one place.
Key facts
- A hypothesis test uses a sample to decide whether a claim about a population is believable.
- The null hypothesis is assumed true; the alternative hypothesis is , or .
- Hypotheses are written in terms of the parameter , never the sample statistic.
- The significance level is the probability of rejecting when it is true.
- Reject if the p-value is at most the significance level (halved in a two-tailed test).
Hypotheses
The null hypothesis is the claim assumed true; the alternative is what we suspect instead.
A hypothesis test uses a sample to judge a claim about a population.
- is the null hypothesis.
- is the alternative hypothesis: , or .
Example: a coin suspected of favouring heads has , .
Null hypothesis
- Assumed true at the start
- Written
- About the parameter
Alternative
- What we suspect instead
- , or
- Accepted only if is rejected
A coin is suspected of being biased towards tails. Which is correct?
Significance level
If is true, we ask how likely the observed result would be, then compare with the significance level.
The test statistic is the value calculated from the sample, here the number of successes . If is true, .
The significance level is chosen in advance, commonly 5% or 1%. It is the probability of incorrectly rejecting when it is true. A smaller level demands stronger evidence.
- 1
Assume is true
so
- 2
Observe the sample
record the value of
- 3
Ask how likely it is
probability of a result at least this extreme under
- 4
Decide
reject if this is no more than the significance level
Why is it harder to reject at 1% than at 5%?
One and two tails
In a one-tailed test the whole significance level sits in one tail; in a two-tailed test it is split equally.
A one-tailed test has in one direction: the whole level goes in that tail.
A two-tailed test has : the level is split equally, so a 10% test has 5% in each tail.
To find the tail, compare the result with the mean . For the mean is 5, so 1 is in the lower tail and 9 in the upper.
For , which tail is an observation of 3 in?
Critical regions
The critical region is the set of results that lead to rejecting ; choose the largest one with probability at most the significance level.
The critical region is the set of values of the test statistic that lead to rejecting . Its boundary is the critical value. The acceptance region is the rest.
For an upper tail, find the smallest with the level. For a lower tail, the largest with the level.
The actual significance level is the probability of the whole critical region under . For and it is .
For , and . What is the upper critical region at 5%?
The p-value
The p-value is the probability, assuming , of a result at least as extreme as the one observed.
For and observed , the p-value is .
- If it is at most the significance level (halved in a two-tailed test), reject .
- Otherwise there is insufficient evidence to reject .
Conclude in context and cautiously: a test never proves or .
- p-value significance levelreject
- p-value significance levelinsufficient evidence to reject
A two-tailed test at 5% gives a one-tail probability of 0.03. What is the conclusion?
Try an exam question
A coin is suspected of being biased towards heads. It is tossed 20 times. Let be the probability of heads. State suitable hypotheses and explain what is meant by the significance level of the test.
[4 marks]
- [1].
- [1].
- [1]The significance level is the probability of rejecting ...
- [1]...when is actually true.
That's the notes covered.
Carry on to the next subtopic.
Try a question
Which pair of hypotheses should be used?
1 mark, marked against the mark scheme
Which pair of hypotheses should be used?
1 mark, marked against the mark scheme