Skewness and outliers

Skewness and outliers

Spec 2.4 · Edexcel International A Level Maths: Revision notes

Studying this course? Keep your progress in one place.

Key facts

  • Positive skew has a longer upper tail: Q3−Q2>Q2−Q1Q_3-Q_2>Q_2-Q_1 and mean >> median >> mode.
  • Negative skew has a longer lower tail: Q3−Q2<Q2−Q1Q_3-Q_2<Q_2-Q_1 and mean << median << mode.
  • The rule for outliers is given in the question: commonly beyond 1.5×IQR1.5\times IQR from the quartiles, or beyond kk standard deviations from the mean.
  • On a box plot, whiskers stop at the most extreme non-outlier and outliers are marked with crosses.
  • Outliers affect the mean and especially the standard deviation, but not the median or IQR much.

Describing skewness

Skewness describes the symmetry of a distribution. The skew is named after the longer tail, and quartile gaps show which tail is longer.

Skewness describes the symmetry of a distribution.

  • If the upper tail is longer, the distribution has positive skew.
  • If the lower tail is longer, it has negative skew.
  • A symmetrical distribution has no skew.

Using quartiles, compare the two gaps Q3−Q2Q_3-Q_2 and Q2−Q1Q_2-Q_1.

246810120.10.20.30.40.50.60.7xyPositive skewSymmetricalNegative skew
Illustrative shapes: positive skew has a long upper tail, negative skew a long lower tail, and a symmetrical distribution has neither.

Positive skew

  • Longer upper tail
  • Q3−Q2>Q2−Q1Q_3-Q_2>Q_2-Q_1

Symmetrical

  • No skew
  • Q3−Q2=Q2−Q1Q_3-Q_2=Q_2-Q_1

Negative skew

  • Longer lower tail
  • Q3−Q2<Q2−Q1Q_3-Q_2<Q_2-Q_1

Worked example

Q1=24Q_1=24, Q2=28Q_2=28, Q3=40Q_3=40. Describe the skew.

Q1=10Q_1=10, Q2=18Q_2=18, Q3=22Q_3=22. What is the skew?

Skewness from mean, median and mode

In a positively skewed distribution the mean is pulled above the median and mode by high values; in a negatively skewed one it is pulled below.

For a positively skewed distribution, extreme high values pull the mean up most. For a negatively skewed distribution, extreme low values pull the mean down most.

For a symmetrical distribution the three averages are equal or very close.

Example: mode 8, median 10 and mean 12 indicates positive skew. This is why the median is often preferred for skewed data such as incomes: it is not distorted by a few very large values.

123456789100.050.10.150.20.250.3xymodemedianmeanPositive skew
Illustrative positively skewed distribution: the high values pull the mean (3) above the median (about 2.67) and the mode (2).

Positive skew

  • mean >> median >> mode

Symmetrical

  • mean = median = mode (or very close)

Negative skew

  • mean << median << mode

A distribution has mean 35, median 40 and mode 44. What is the skew?

Outliers

An outlier is a value unusually far from the rest. The identification rule is always given in the question.

An outlier is a value that is unusually far from the rest of the data. Outliers may be genuine extreme values or recording errors, so investigate before removing them.

In an exam the rule for identifying outliers is always given in the question. Two common rules:

  • more than 1.5×IQR1.5\times IQR above Q3Q_3 or below Q1Q_1
  • more than kk standard deviations from the mean, outside xˉ±kσ\bar x\pm k\sigma

Measure from Q3Q_3 upwards and from Q1Q_1 downwards, and test both ends.

051015202530354045505560Q₁ − 1.5 IQR = 5Q₁Q₃Q₃ + 1.5 IQR = 45
Illustrative values (Q₁ = 20, Q₃ = 30, IQR = 10): with the 1.5 × IQR rule, values outside 5 to 45 are outliers.
  • Upper limitQ3+1.5(Q3−Q1)Q_3+1.5(Q_3-Q_1)
  • Lower limitQ1−1.5(Q3−Q1)Q_1-1.5(Q_3-Q_1)

Worked example

Q1=2Q_1=2 and Q3=11Q_3=11. Using the 1.5×IQR1.5\times IQR rule, are 40 and 19 outliers?

With Q1=10Q_1=10 and Q3=18Q_3=18, what is the upper limit using 1.5×IQR1.5\times IQR?

Outliers on a box plot

Each whisker stops at the most extreme value that is not an outlier, and each outlier is marked separately with a cross.

A box plot shows the minimum, Q1Q_1, median, Q3Q_3 and maximum. The box runs from Q1Q_1 to Q3Q_3 with a line at the median.

When there are outliers, each whisker stops at the most extreme value that is not an outlier, and each outlier is marked separately, usually with a cross.

If there is no outlier at an end, the whisker goes to the smallest or largest value.

  1. 1

    Work out both limits

    for outliers

  2. 2

    Find the extremes

    largest and smallest non-outliers

  3. 3

    Draw the box

    Q₁ to Q₃ with a line at the median

  4. 4

    Draw whiskers and crosses

    whiskers to the extremes, crosses for outliers

Drawing a box plot with outliers.

Worked example

Q1=2Q_1=2, median 5, Q3=11Q_3=11, smallest 0, largest 40, next largest 19, with 40 an outlier. Describe the box plot.

Where does the upper whisker end when the largest value is an outlier?

The effect of outliers

Outliers have a large effect on the mean and especially the standard deviation, but little effect on the median and IQR.

Outliers have a large effect on the mean and especially on the standard deviation, because deviations are squared. They have little effect on the median and the IQR.

When an outlier is removed, update nn, ∑x\sum x and ∑x2\sum x^2 and recalculate.

Whether the mean rises or falls depends on which side the outlier lies.

0246810MeanMedianStandard deviation
  • Before
  • After adding 30
Data 4, 5, 6, 7, 8 before and after adding an outlier of 30 (population standard deviation): the mean and standard deviation jump, the median barely moves.

Affected a lot

  • Mean
  • Standard deviation

Affected little

  • Median
  • Interquartile range

Worked example

n=20n=20, ∑x=1240\sum x=1240, ∑x2=78 880\sum x^2=78\,880 (mean 62, standard deviation 10). Remove the marks 38 and 85.

Which measure is least affected by an outlier?

Try an exam question

A data set has Q1=18Q_1=18, Q2=24Q_2=24 and Q3=36Q_3=36. (a) Describe the skewness, giving a reason. (b) An outlier is a value more than 1.5×IQR1.5\times IQR above Q3Q_3 or below Q1Q_1. Determine whether the value 7070 is an outlier.

[4 marks]

That's the notes covered.

Carry on to the next subtopic.

Try a question

Describe the skewness of the distribution using the quartiles.

1 mark, marked against the mark scheme

Revision notes