Outliers and data cleaning

Outliers and data cleaning Flashcards

Spec L4 · AQA A-Level Maths: Flashcards

Studying this course? Keep your progress in one place.

Flip each card. Be honest: the ones you mark Not yet come back first.

13 cards

Tap a card to flip it. Swipe right if you knew it, left if not.

See all 13 cards
What is an outlier?
A value unusually far from the rest of the data, as defined by a stated rule.
State the quartile rule for outliers.
More than 1.5×IQR1.5\times\text{IQR} above Q3Q_3, or more than 1.5×IQR1.5\times\text{IQR} below Q1Q_1.
State the standard deviation rule for outliers.
More than kk standard deviations from the mean (e.g. 2 or 3).
Upper boundary when Q1=24Q_1=24 and Q3=36Q_3=36?
36+1.5×12=5436+1.5\times12=54
How are outliers shown on a box plot?
As separate points beyond the whiskers.
How do you deal with missing data?
Exclude it from the calculation and note it; do not treat it as 0.
How do you deal with an obvious error such as −1-1 for a spend?
Correct it if the true value is known, otherwise remove it.
What do you do with a genuine outlier?
Keep it, comment on its effect, and perhaps give results with and without it.
Which average is least affected by an outlier?
The median.
Which measure of spread is least affected by an outlier?
The interquartile range.
Why is a value exactly on the boundary not an outlier?
The rule says 'more than', so it must be beyond the boundary.
What should you check first about a suspected outlier?
Whether it is an error, by checking it against the source.
A wrong value aa should be bb. How does the total change?
Subtract aa and add bb.

Flashcards