Type I and Type II errors and power

Type I and Type II errors and power Test

Spec 8.1 · Edexcel A-Level Further Maths: Subtopic test

Studying this course? Keep your progress in one place.

Two ways to do this test

Question by question

One question at a time. Each answer is marked the moment you hand it in, so you learn as you go. Drago helps if you get stuck. All 10 questions, or just 5.

Exam mode

The whole paper in one go, timed like the real exam. Nothing is marked until you hand it in, then you get every mark explained.

10 questions, 27 marks

Edexcel A-Level Further Maths

Type I and Type II errors and power

Total 27 marks

Name

Class

Date

  1. 1
    A coin is suspected of being biased towards heads. It is tossed 10 times and XX is the number of heads, where X∼B(10,p)X\sim\mathrm{B}(10,p). The hypotheses are H0:p=0.5\mathrm{H}_0:p=0.5 and H1:p>0.5\mathrm{H}_1:p>0.5, and H0\mathrm{H}_0 is rejected if X≥8X\geq8.
    (a)
    Find the size of the test.
    [1 mark]
    • A0.01070.0107
    • B0.04390.0439
    • C0.94530.9453
    • D0.05470.0547
    Show the mark scheme

    Mark scheme

    Answer: D
    (b)
    Find the probability of a Type II error when the true value is p=0.7p=0.7.
    [1 mark]
    • A0.6170.617
    • B0.3830.383
    • C0.05470.0547
    • D0.9450.945
    Show the mark scheme

    Mark scheme

    Answer: A
    (c)
    Find the power of the test when p=0.6p=0.6.
    [2 marks]
    Show the mark scheme

    Mark scheme

    M1: P(X≥8)\mathrm{P}(X\geq8) with X∼B(10,0.6)X\sim\mathrm{B}(10,0.6), or 1−P(X≤7)1-\mathrm{P}(X\leq7)
    A1:
    0.1670.167
    Accept:
    0.16730.1673

    Total for question 1: 4 marks

  2. 2
    The number of defects on a sheet of metal is modelled by Po(λ)\mathrm{Po}(\lambda). One sheet is inspected to test H0:λ=2\mathrm{H}_0:\lambda=2 against H1:λ>2\mathrm{H}_1:\lambda>2. The test rejects H0\mathrm{H}_0 if the sheet has 5 or more defects.
    (a)
    Find the size of the test.
    [1 mark]
    • A0.94730.9473
    • B0.05270.0527
    • C0.01660.0166
    • D0.09020.0902
    Show the mark scheme

    Mark scheme

    Answer: B
    (b)
    Find the probability of a Type II error when the true mean is λ=4\lambda=4.
    [1 mark]
    • A0.3710.371
    • B0.7850.785
    • C0.6290.629
    • D0.4340.434
    Show the mark scheme

    Mark scheme

    Answer: C
    (c)
    The critical region is changed to X≥6X\geq6. State, with a supporting calculation, the effect on the size of the test and on the power of the test when λ=4\lambda=4.
    [2 marks]
    Show the mark scheme

    Mark scheme

    B1: size decreases, because P(X≥6∣λ=2)=0.0166<0.0527\mathrm{P}(X\geq6\mid\lambda=2)=0.0166<0.0527
    B1: power decreases, because
    P(X≥6∣λ=4)=0.215<0.371\mathrm{P}(X\geq6\mid\lambda=4)=0.215<0.371
    Accept: p-values or decimals correct to 2 significant figures

    Total for question 2: 4 marks

  3. 3
    A machine fills cereal boxes, and the mass of cereal in a box, in grams, is normally distributed with standard deviation 22. The mean mass should be 500500 but the manager suspects it is lower. The manager tests H0:μ=500\mathrm{H}_0:\mu=500 against H1:μ<500\mathrm{H}_1:\mu<500 using the mean xˉ\bar x of a random sample of 16 boxes, and rejects H0\mathrm{H}_0 if xˉ<499\bar x<499.
    (a)
    Find the size of the test.
    [3 marks]
    Show the mark scheme

    Mark scheme

    M1: under H0\mathrm{H}_0, Xˉ∼N(500,2216)\bar X\sim\mathrm{N}\left(500,\frac{2^2}{16}\right), so standard deviation 0.50.5
    M1:
    P(Xˉ<499)=P(Z<499−5000.5)\mathrm{P}(\bar X<499)=\mathrm{P}\left(Z<\frac{499-500}{0.5}\right)
    A1:
    P(Z<−2)=0.0228\mathrm{P}(Z<-2)=0.0228
    Accept:
    0.022750.02275
    (b)
    Find the power of the test when the true mean mass is 498.5498.5, and explain what this value represents.
    [4 marks]
    Show the mark scheme

    Mark scheme

    B1: power is the probability of rejecting H0\mathrm{H}_0 when it is false, here P(Xˉ<499∣μ=498.5)\mathrm{P}(\bar X<499\mid\mu=498.5)
    M1:
    Xˉ∼N(498.5,0.52)\bar X\sim\mathrm{N}(498.5,0.5^2) and P(Z<499−498.50.5)\mathrm{P}\left(Z<\frac{499-498.5}{0.5}\right)
    A1:
    P(Z<1)\mathrm{P}(Z<1)
    A1:
    0.8410.841, the probability of correctly detecting that the mean is below 500
    Accept:
    0.84130.8413

    Total for question 3: 7 marks

  4. 4
    A manufacturer claims that the proportion of defective bulbs is p=0.1p=0.1. A buyer takes a random sample of 20 bulbs to test H0:p=0.1\mathrm{H}_0:p=0.1 against H1:p>0.1\mathrm{H}_1:p>0.1, where XX is the number of defective bulbs in the sample. Test A rejects H0\mathrm{H}_0 if X≥5X\geq5. Test B rejects H0\mathrm{H}_0 if X≥4X\geq4.
    (a)
    Find the size of each test, and the probability of a Type II error for each test when p=0.2p=0.2.
    [6 marks]
    Show the mark scheme

    Mark scheme

    M1: Test A size =P(X≥5∣p=0.1)=1−P(X≤4)=\mathrm{P}(X\geq5\mid p=0.1)=1-\mathrm{P}(X\leq4) with X∼B(20,0.1)X\sim\mathrm{B}(20,0.1)
    A1:
    0.04320.0432
    A1: Test B size
    =1−P(X≤3)=0.133=1-\mathrm{P}(X\leq3)=0.133
    M1: Test A Type II
    =P(X≤4∣p=0.2)=\mathrm{P}(X\leq4\mid p=0.2) with X∼B(20,0.2)X\sim\mathrm{B}(20,0.2)
    A1:
    0.6300.630
    A1: Test B Type II
    =P(X≤3∣p=0.2)=0.411=\mathrm{P}(X\leq3\mid p=0.2)=0.411
    Accept:
    0.1330.133 to 3 s.f. or 0.13300.1330
    (b)
    The buyer wants a test with size at most 0.050.05 that has power at least 0.80.8 when p=0.3p=0.3. Find the power of each test when p=0.3p=0.3, and evaluate whether either test meets the buyer's requirements. Suggest what the buyer could change.
    [6 marks]
    Show the mark scheme

    Mark scheme

    M1: power of A =P(X≥5∣p=0.3)=\mathrm{P}(X\geq5\mid p=0.3) with X∼B(20,0.3)X\sim\mathrm{B}(20,0.3)
    A1:
    0.7620.762
    M1: power of B
    =P(X≥4∣p=0.3)=\mathrm{P}(X\geq4\mid p=0.3)
    A1:
    0.8930.893
    R1: A has size
    0.0432≤0.050.0432\leq0.05 but power 0.762<0.80.762<0.8, so fails the power requirement; B has power 0.893≥0.80.893\geq0.8 but size 0.133>0.050.133>0.05, so fails the size requirement
    R1: neither test meets both requirements; the buyer could increase the sample size (which raises power for the same size)

    Accept: any valid suggestion, such as a larger sample

    Accept:
    0.7630.763 for the power of A (from rounding the table value)

    Total for question 4: 12 marks

End of questions

Subtopic tests