All revision notes topics

4.14 Linear combinations of random variables and unbiased estimatesIB Maths: Applications and Interpretation HL: Revision notes

Section 1

Linear transformation of one random variable

If XX is a random variable and aa, bb are constants then E(aX+b)=aE(X)+b.E(aX+b)=aE(X)+b. The mean is shifted and scaled in the same way as each value. For the variance, Var(aX+b)=a2Var(X)Var(aX+b)=a^2Var(X): adding bb does not change the spread and multiplying by aa multiplies the variance by a2a^2 (you will not be asked to recall this variance formula for a single variable, but it explains the results for combinations). Example: E(X)=120E(X)=120 and income I=15X+200I=15X+200 gives E(I)=15(120)+200=2000E(I)=15(120)+200=2000.

Key termslinear transformationexpected valuevariance
Common mistake

Applying the same rule to variance, such as Var(15X+200)=15Var(X)+200Var(15X+200)=15Var(X)+200. The constant disappears and the multiplier is squared.

Section 2

Linear combinations of random variables

For any random variables X1,…,XnX_1,\ldots,X_n and constants a1,…,ana_1,\ldots,a_n, E(a1X1+⋯+anXn)=a1E(X1)+⋯+anE(Xn).E(a_1X_1+\cdots+a_nX_n)=a_1E(X_1)+\cdots+a_nE(X_n). This holds whether or not the variables are independent. If the variables are independent, Var(a1X1+⋯+anXn)=a12Var(X1)+⋯+an2Var(Xn).Var(a_1X_1+\cdots+a_nX_n)=a_1^2Var(X_1)+\cdots+a_n^2Var(X_n). So for independent XX and YY: Var(X+Y)=Var(X)+Var(Y)Var(X+Y)=Var(X)+Var(Y) and, because (−1)2=1(-1)^2=1, Var(X−Y)=Var(X)+Var(Y)Var(X-Y)=Var(X)+Var(Y). Variances add even when the variables are subtracted. Example: E(X)=120E(X)=120, Var(X)=64Var(X)=64, E(Y)=90E(Y)=90, Var(Y)=36Var(Y)=36. Then E(X+Y)=210E(X+Y)=210 and Var(X−Y)=100Var(X-Y)=100.

Key termslinear combinationindependentvariance of a sum
Common mistake

Subtracting the variances for X−YX-Y. Variances always add for independent variables.

Section 3

X1+X2X_1+X_2 is not the same as 2X2X

If X1X_1 and X2X_2 are two independent copies of XX (for example two separate drivers) then E(X1+X2)=2E(X)E(X_1+X_2)=2E(X) and Var(X1+X2)=2Var(X)Var(X_1+X_2)=2Var(X). But for one variable doubled, E(2X)=2E(X)E(2X)=2E(X) while Var(2X)=4Var(X)Var(2X)=4Var(X). The means agree but the variances differ: in X1+X2X_1+X_2 a high value of one can be offset by a low value of the other, whereas 2X2X doubles one value. Check which situation the question describes: separate independent items or one item counted several times.

Key termsindependent copies$2X$$X_1+X_2$
Exam tip

Ask: are these separate items, or the same item counted more than once? The first gives nVar(X)nVar(X), the second gives n2Var(X)n^2Var(X).

Section 4

Unbiased estimates of the mean

A sample is used to estimate the properties of a population. An estimate is unbiased if its expected value equals the parameter being estimated: on average it is neither too high nor too low. The sample mean is an unbiased estimate of the population mean: xˉ=∑xin(or xˉ=∑fixin for a frequency table),\bar x=\frac{\sum x_i}{n}\quad(\text{or }\bar x=\frac{\sum f_ix_i}{n}\text{ for a frequency table}), so E(Xˉ)=μE(\bar X)=\mu. (The proof is not examined.) Example: masses 58,61,63,60,57,6558, 61, 63, 60, 57, 65 give xˉ=3646=60.7\bar x=\frac{364}{6}=60.7 g as an unbiased estimate of μ\mu.

Key termssamplepopulationunbiased estimatesample mean
Exam tip

If the question says "unbiased estimate of the population mean", the answer is just the sample mean.

Section 5

Unbiased estimates of the variance

The variance of the sample, dividing by nn, sn2=∑fi(xi−xˉ)2n,s_n^2=\frac{\sum f_i(x_i-\bar x)^2}{n}, systematically underestimates σ2\sigma^2. The unbiased estimate divides by n−1n-1: sn−12=nn−1sn2=∑fi(xi−xˉ)2n−1,n=∑fi.s_{n-1}^2=\frac{n}{n-1}s_n^2=\frac{\sum f_i(x_i-\bar x)^2}{n-1},\quad n=\sum f_i. On most GDCs, σx\sigma_x is sns_n and sxs_x is sn−1s_{n-1} (check your model). Square the standard deviation to get the variance. Example: for the six eggs, sn2=7.56s_n^2=7.56, so sn−12=65(7.56)=9.07s_{n-1}^2=\frac{6}{5}(7.56)=9.07 g2^2. For a frequency table with n=40n=40 and sn2=1.634s_n^2=1.634: sn−12=4039(1.634)=1.68s_{n-1}^2=\frac{40}{39}(1.634)=1.68.

Key termsunbiased estimate of variance$s_{n-1}^2$$s_n^2$
Common mistake

Reading the wrong standard deviation from the GDC. If you need sn−1s_{n-1}, check that it is the one marked with n−1n-1 or sxs_x.

Section 6

Using estimates in a model

Once xˉ\bar x and sn−12s_{n-1}^2 are found, treat them as μ\mu and σ2\sigma^2 in the linear combination formulas. Example (parcels per driver): xˉ=10.375\bar x=10.375, sn−12=1.676s_{n-1}^2=1.676. For payment P=6X+40P=6X+40: E(P)=6(10.375)+40=102.25E(P)=6(10.375)+40=102.25 AED. For two independent drivers: E(X1+X2)=20.75E(X_1+X_2)=20.75 and Var(X1+X2)=2(1.676)=3.35Var(X_1+X_2)=2(1.676)=3.35. State clearly that these are estimates. Keep unrounded values until the final answer and give 3 significant figures (money to 2 decimal places).

Key termsestimateexpected payment
Exam tip

Write "estimate" or the hat notation in your answer to show you know it comes from a sample.

That's the notes covered.

Carry on to the next subtopic.

Exam questions on 4.14 Linear combinations of random variables and unbiased estimates

  1. On Saturdays the number of customers at a café is the random variable XX with mean 120120 and variance 6464. On Sundays the number of customers is the random variable YY with mean 9090 and variance 3636. XX and YY are independent. On a Saturday the café's income is I=15X+200I=15X+200 AED.
    Find the expected income on a Saturday.2 marks
  2. The masses, in grams, of a random sample of six eggs from a farm are 58,61,63,60,57,6558, 61, 63, 60, 57, 65. Use your GDC where needed.
    The variance of the six masses, dividing by 66, is sn2=7.56s_n^2=7.56. Show how this gives the unbiased estimate 9.079.07 from part (b), and explain why this estimate is used rather than 7.567.56.2 marks
  3. A bakery sells a loaf with mass LL grams, where E(L)=800E(L)=800 and Var(L)=25Var(L)=25, and rolls whose individual masses RR grams have E(R)=60E(R)=60 and Var(R)=4Var(R)=4. The mass of the loaf and the masses of different rolls are all independent.
    A bag contains one loaf and five rolls, with total mass W=L+R1+R2+R3+R4+R5W=L+R_1+R_2+R_3+R_4+R_5. Find E(W)E(W) and Var(W)Var(W).3 marks
See the full worksheet

Written by the Exaim team, led by Shaun Daswani (Head of Upper Secondary, Improve ME Institute; MSc Financial Mathematics, Imperial College London; BSc, UCL) and Jason Daswani (operational lead, Improve ME Institute; LSE).