The Gamma Distribution

Show that the probability density function of the $k$ arrival time is

f k t r k t k 1 k 1 r t, t 0

This distribution is the gamma distribution with shape parameter

k

and rate parameter

r

. Again,

1 r

is knows as the scale parameter. A more general version of the gamma distribution, allowing non-integer shape parameters, is studied in the chapter on Special Distributions.

Note that since the arrival times are continuous, the probability of an arrival at any given instant of time is 0. Thus, we can also interpret

N t

as the number of arrivals in

0 t

In the gamma experiment, vary $r$ and $k$ with the scroll bars and watch how the shape of the probability density function changes. Now set $r 2$ and $k 3$ , run the experiment 1000 times with an update frequency of 10, and watch the apparent convergence of the empirical density function to the true density function.

Sketch the graph of the probability density function in Exercise 1. Show that the density function at first increases and then decreases, reaching its maximum value at the mode $k 1 r$ .

Suppose that customers arrive at a service station according to the Poisson model, at a rate of $r 3$ per hour. Relative to a given starting time, find the probability that the second customer arrives sometime after 1 hour.

Defects in a type of wire follow the Poisson model, with rate 1 per 100 meter. Find the probability that the $5$ defect is located between 450 and 550 meters.

Moments

The mean, variance, and moment generating function of

T k

can be found using basic properties and the corresponding results for the exponential distribution

Show that $T k k r$ .

Show that $T k k r 2$ .

In the gamma experiment, vary $r$ and $k$ with the scroll bars and watch how the size and location of the mean/standard deviation bar changes. Now set $r 2$ and $k 3$ , run the experiment 1000 times with an update frequency of 10, and watch the apparent convergence of the empirical moments to the true moments.

Show that $u T k r r u k$ for $u r$ .

Suppose that requests to a web server follow the Poisson model with rate $r 5$ . Relative to a given starting time, compute the mean and standard deviation of the time of the $10$ request.

Suppose that $Y$ has a gamma distribution with mean 40 and standard deviation 20. Find the shape parameter $k$ and the rate parameter $r$ .

Sums of Independent Gamma Variables

Suppose that $V$ has the gamma distribution with shape parameter $j$ and rate parameter $r$ , that $W$ has the gamma distribution with shape parameter $k$ and rate parameter $r$ , and that $V$ and $W$ are independent. Show that $V W$ has the gamma distribution with shape parameter $j k$ and rate parameter $r$ .

Give an analytic proof, using moment generating functions.
Give an analytic proof, using probability density functions.
give a probabilistic proof, based on the Poisson process.

Normal Approximation

In the gamma experiment, vary $r$ and $k$ with the scroll bars and watch how the shape of the density function changes. Now set $r 3$ and $k 5$ run the experiment 1000 times with an update frequency of 10, and watch the apparent convergence of the empirical density function to the true density function.

Even though you are restricted to small values of

k

in the applet, note that the probability density function of the

k

arrival time becomes more bell shaped as

k

increases (for

r

fixed). This is yet another application of the central limit theorem, since the

k

arrival time is the sum of

k

independent, identically distributed random variables (the interarrival times).

Use the central limit theorem to show that the distribution of the standardized variable below converges to the standard normal distribution as $k$ :

Z k r T k k k

In the gamma experiment, set $k 5$ and $r 2$ . Run the experiment 1000 times, updating after every run. Compute and compare the following:

$1.5 T 5 3$ .
The relative frequency of the event $1.5 T 5 3$ .
The normal approximation to $1.5 T 5 3$ .

Suppose that accidents at an intersection occur according to the Poisson model, at a rate of 8 per year. Compute the normal approximation to the event that the $10$ accident (relative to a given starting time) occurs within 2 years.

Estimating the Rate

In many practical situations, the rate

r

of the process in unknown and must be estimated based on observing the arrival times.

Show that $T k k 1 r$ and hence $T k k$ is an unbiased estimator of $1 r$ .

Since the estimator is unbiased, the variance measures the mean square error of the estimator.

Show that $T k k 1 k r 2$ and hence $T k k 0$ as $k$ . This means that $T k k$ is a consistent estimator of $1 r$ .

where

X i

is the

i

interarrival time. Hence our estimator of

1 r

can be interpreted as the sample mean of the interarrival times. In particular, by the law of large numbers,

T k k 1 r

k

with probability 1. A natural estimator of the rate itself is

k T k

. However, this estimator tends to overestimate

r

Use Jensen's inequality to show that $k T k r$ .

Suppose that requests to a web server follow the Poisson model. Starting at 12:00 noon on a certain day, the requests are logged. The $100$ request comes at 12:15. Estimate the rate of the process.

3. The Gamma Distribution

The Probability Density Function

Moments

Sums of Independent Gamma Variables

Normal Approximation

Estimating the Rate