Least squares regression and residuals

Least squares regression and residuals Flashcards

Spec 1.1–2 · Edexcel A-Level Further Maths: Flashcards

Studying this course? Keep your progress in one place.

Flip each card. Be honest: the ones you mark Not yet come back first.

13 cards

Tap a card to flip it. Swipe right if you knew it, left if not.

See all 13 cards
Formula for the gradient bb of the regression line of yy on xx?
b=SxySxxb=\dfrac{S_{xy}}{S_{xx}}
Formula for the intercept aa?
a=yˉ−bxˉa=\bar y-b\bar x
Formula for SxyS_{xy}?
∑xy−∑x∑yn\sum xy-\dfrac{\sum x\sum y}{n}
Formula for SxxS_{xx}?
∑x2−(∑x)2n\sum x^2-\dfrac{(\sum x)^2}{n}
What does the least squares method minimise?
The sum of the squares of the vertical distances (residuals) from the points to the line.
Define a residual.
Observed yy minus predicted y^\hat y: yi−(a+bxi)y_i-(a+bx_i).
What does a negative residual mean?
The point lies below the regression line (the model overestimates).
Formula for the residual sum of squares?
RSS=Syy−(Sxy)2Sxx\text{RSS}=S_{yy}-\dfrac{(S_{xy})^2}{S_{xx}}
What do the residuals of a least squares line sum to?
Zero.
Which point does the regression line always pass through?
(xˉ,yˉ)(\bar x,\bar y)
What does a pattern in the residuals suggest?
A linear model may not be suitable (for example, curvature).
What is extrapolation, and why is it risky?
Predicting outside the data range; the linear relationship may not continue.
How do you decide whether to remove an outlier?
Only if there is a reason (such as a recording error); then recalculate the line and RSS and compare.

Flashcards