Probability generating functions
Studying this course? Keep your progress in one place.
Key facts
- The probability generating function is : the coefficient of is .
- Always : use it as a check.
- and .
- For independent and : .
- Know the PGFs of the binomial, Poisson, geometric and negative binomial distributions.
Definition and basic properties
A PGF is a power series whose coefficients are the probabilities.
For a discrete random variable taking non-negative integer values, the probability generating function (PGF) is .
The coefficient of is , so you can read off probabilities from a PGF written as a polynomial or power series.
Since probabilities sum to 1, always. Check this every time: if it fails, an error has crept in.
For , , : .
- Probability generating function
A PGF is . What is ?
Mean and variance from the PGF
Differentiate and set : the first derivative gives the mean, and the second gives the variance.
Differentiating term by term, , so at the mean is .
Differentiating again gives . Hence .
Proofs of these standard results may be asked for in the exam. Do not use as the variance, and do not forget to subtract .
Worked example
Find and when .
- 1
Differentiate: , so .
- 2
Differentiate again: , so .
- 3
Substitute: .
If and , what is ?
PGFs of standard distributions
Each PGF comes straight from the definition, using the binomial theorem, the exponential series or a geometric series.
You must be able to derive each PGF from the definition and use it for the mean and variance.
- Binomial : , from the binomial theorem.
- Poisson : , from .
- Geometric (trials to the first success): , from a geometric series, valid for .
- Negative binomial (trials to the th success): , a sum of independent geometric variables.
The geometric PGF counts trials including the success, not failures.
Binomial B(n, p)
Poisson Po(λ)
Geometric
Negative binomial
Which PGF belongs to a variable?
Sums of independent variables
For independent variables, the PGFs multiply.
If and are independent, then , so . Derivation is not required.
It extends to any number of independent variables: the sum of independent copies of has PGF .
Adding PGFs instead of multiplying them is a common error.
- independent
- independent copies of
Worked example
Find the PGF of plus an independent , and identify the sum of independent and .
- 1
Multiply the PGFs: .
- 2
For two Poisson variables: .
and are independent with PGFs and . What is the PGF of ?
Worked example: geometric
Write the PGF, differentiate twice, then use the standard formulae.
Take with , so . The PGF is .
Simplify before differentiating a second time; it saves quotient-rule errors. The result agrees with and .
For the trials to the third success, has PGF .
Worked example
For , find and , then the mean of the number of trials to the third success.
- 1
Differentiate: , so .
- 2
Differentiate again: , so .
- 3
Variance: , which agrees with .
- 4
Third success: has , so .
For a geometric variable with , what is ?
Try an exam question
The random variable has probability generating function . Use the PGF to find and .
[5 marks]
- [1].
- [1].
- [1], so .
- [1]Uses .
- [1].
That's the notes covered.
Carry on to the next subtopic.
Try a question
Find .
1 mark, marked against the mark scheme
Find .
1 mark, marked against the mark scheme