Least squares regression and residuals Flashcards
Studying this course? Keep your progress in one place.

Flip each card. Be honest: the ones you mark Not yet come back first.
13 cards
Tap a card to flip it. Swipe right if you knew it, left if not.
See all 13 cards
- Formula for the gradient of the regression line of on ?
- Formula for the intercept ?
- Formula for ?
- Formula for ?
- What does the least squares method minimise?
- The sum of the squares of the vertical distances (residuals) from the points to the line.
- Define a residual.
- Observed minus predicted : .
- What does a negative residual mean?
- The point lies below the regression line (the model overestimates).
- Formula for the residual sum of squares?
- What do the residuals of a least squares line sum to?
- Zero.
- Which point does the regression line always pass through?
- What does a pattern in the residuals suggest?
- A linear model may not be suitable (for example, curvature).
- What is extrapolation, and why is it risky?
- Predicting outside the data range; the linear relationship may not continue.
- How do you decide whether to remove an outlier?
- Only if there is a reason (such as a recording error); then recalculate the line and RSS and compare.