Language of hypothesis testing
Studying this course? Keep your progress in one place.
Key facts
- is the claim assumed true (one value, ); is what you suspect, and its direction comes from the question.
- A 1-tail test has or ; a 2-tail test has .
- Work under : use .
- Reject if the -value is the significance level, or if is in the critical region.
- Conclude in context, cautiously: never say has been proved.
Hypotheses
A hypothesis test uses a sample to decide whether a claim about a parameter is believable. is the claim assumed true; is what you suspect instead.
For a binomial model the parameter is . gives one value, such as .
Always define in words, for example 'p is the probability that a seed germinates'.
The direction of comes from the wording of the question, never from the sample result.
1-tail test
- or
- The suspicion has a direction
2-tail test
- The suspicion is only that the value has changed
A company claims 60% of customers are satisfied. A manager thinks the figure is lower. Which is the correct alternative hypothesis?
The test statistic
The test statistic is the quantity calculated from the sample, here the number of successes . You work under to see how likely the result would be.
The test asks: if is true, how likely is a result like the one observed?
So use the distribution under , for example if and . Only the value of from is used in the calculation.
- 1
State hypotheses
H₀ and H₁, with p defined
- 2
Assume H₀
Use its distribution for X
- 3
Compare
Observed X against the critical region or p-value
- 4
Conclude
In context
and . Which distribution is used for the test statistic?
Critical region
The significance level is how unlikely a result must be before you reject . The critical region is the set of results that lead to rejection.
The significance level is the probability of rejecting when it is true, set in advance (commonly 5% or 1%).
The critical region is the set of values of the test statistic that lead to rejecting ; its boundary is the critical value. The rest is the acceptance region.
For a 1-tail test all of is in one tail. For a 2-tail test at 5%, put at most in each tail.
Worked example
and at the 5% level. Find the critical region.
- 1
The critical region is in the lower tail, so find the largest with .
- 2
.
- 3
, so 8 is too large.
- 4
The critical region is , the critical value is and the acceptance region is .
In a 2-tail test at the 5% level, what is the maximum probability allowed in each tail?
The p-value
The -value is the probability, assuming is true, of a result at least as extreme as the one observed. Reject if it is no more than .
For and an observed value of 9 with , the -value is .
Decision rule: if the -value is less than or equal to the significance level, reject ; otherwise do not reject.
In a 2-tail test, compare the one-tail probability with , or double it and compare with .
With and a -value of in a 1-tail test, what is the decision?
Actual significance and conclusions
With a discrete distribution the critical region rarely uses up exactly . Conclusions must be in context and cautious.
The actual significance level is the real probability of falling in the critical region when is true. For with critical region or : , below 5%.
Never say that has been proved. The significance level is also the probability of wrongly rejecting a true .
Result in the critical region
- Reject H₀
- There is sufficient evidence at the 5% level to suggest that the proportion has changed
Result not in the critical region
- Do not reject H₀
- There is insufficient evidence to suggest that it has changed
The test statistic is not in the critical region. Which conclusion is best?
Try an exam question
A spinner is claimed to land on red with probability . Sam thinks the probability is higher. In spins it lands on red times. Test Sam's suspicion at the 5% significance level.
[5 marks]
- [1] and , where is the probability of red.
- [1]Under , .
- [1].
- [1], so reject .
- [1]There is sufficient evidence at the 5% level to suggest that the probability of red is higher than 0.25.
That's the notes covered.
Carry on to the next subtopic.
Try a question
Which pair of hypotheses should she use?
1 mark, marked against the mark scheme
Which pair of hypotheses should she use?
1 mark, marked against the mark scheme