Understanding Continuous Distributions

Expert reviewed 21 July 2024 16 minute read


  • understand and use the concepts of a probability density function of a continuous random variable
    • know the two properties of a probability density function:f(x)0f(x)\geq0 for all real xx and f(x)dx=1\int_{-\infty}^\infty f(x)dx=1
    • define the probability as the area under the graph of the probability density function using the notation P(Xr)=arf(x)dxP(X\leq r)=\int_a^r f(x)dx, where f(x)f(x) is the probability density function defined on [a,b][a,b]
    • examine simple types of continuous random variables and use them in appropriate contexts
    • explore properties of a continuous random variable that is uniformly distributed
    • find the mode from a given probability density function
  • obtain and analyse a cumulative distribution function with respect to a given probability density function
    • understand the meaning of a cumulative distribution function with respect to a given probability density function
    • use a cumulative distribution function to calculate the median and other percentiles

Note:

Video coming soon!

What are Continuous Distributions?

A continuous probability distribution is a way to determine the probability of all possible outcomes of a continuous random variable. A continuous random variable is a variable that can take any value within a given range. This differs from a discrete random variable, which can only take on distinct separate values.

The Difference Between Continuous and Discrete Distributions

Understanding the difference between continuous and discrete distributions can be difficult. In simple terms, a discrete distribution is similar to counting specific outcomes. For example, when counting coins, you can have a specific number of coins (1  coin,2  coin,etc...)(1 \;coin, 2\;coin, etc...). Alternatively, a continuous distribution is like measuring a variable within a range. For example, when measuring a variable such as a length between the range of 1.5m2m1.5m-2m, there are infinite outcomes (eg.  1.60009m)(eg. \;1.60009m).

Probability Density Functions

The Probability Density Function (PDF) of a continuous distribution describes the probability density at each point in the continuous range of the random variable. The probability that the variable falls within a certain interval is found by integrating the PDF over that interval. This is known as the cumulative distribution function, which will be explored later in the chapter.

In simple terms, a probability density function (PDF) describes the likelihood of a continuous random variable taking on a particular value. The PDF, denoted by f(x)f(x) which lies within the bounds [a,b][a,b], has the following properties:

  • f(x)0f(x)\geq0 for all xx
  • The area under the entire PDF curve is 11
abf(x)dx=1∫_{a}^bf(x)dx=1

These properties will be vital to calculations related to the problems involving determining the cumulative distribution function over a given interval.

The Cumulative Distribution Function of a Continuous Distribution

As we now know, a continuous distribution operates with an infinite amount of outcomes within a certain interval. For the following formula, we use the interval [a,b][a,b]. Thus, we let the a continuous random variable XX have values (x)(x) which lie in this interval. The cumulative distribution function (CDF) of this continuous distribution is denoted by F(x)F(x). As such, we can use the following formula:

As we now know, a continuous distribution operates with infinite outcomes over a given interval. For the following formula, we use the interval [a,b][a,b]. Thus, we let a continuous random variable XX have values (x)(x) that lie in this interval. The cumulative distribution function (CDF) of this continuous distribution is denoted by F(x)F(x). As such, we can use the following formula:

F(x)=P(aXb)=abf(x)dxF(x)=P(a\leq X\leq b)=\int_a^bf(x)dx

where,

  • aa and bb are scores that create an interval or range which can be replace with a value of xx
  • P(aXb)P(a\leq X\leq b) is the probability that XX falls within the interval [a,b][a,b]
  • f(x)f(x) is the probability density function of the continuous distribution

As we can see from the formula above, the cumulative distribution function F(x)F(x) is the integral of the PDF up to that value. Thus, another way to find the Probability of a score or interval can be to integrate the PDF. We can use the skills and knowledge gathered in module 4 to assist us with this task.

Additionally, the CDF is useful for calculating probabilities over intervals. For example, to find the probability that XX falls between two values aa and bb, you can use:

P(a<Xb)=F(b)F(a)P(a<X≤b)=F(b)−F(a)

Specific Properties of the Cumulative Distribution Function

Let a continuous random variable XX **have values from a closed interval [a,b][a,b]. The cumulative distribution function has the following properties:

  • 0F(x)10≤F(x)≤1 for all xx: This means that the probability of the function at any point in time can’t be negative. Additionally, the probability is not able to exceed 11.
  • As xx, which is the score approaches aa, F(x)F(x) which is the probability of the function approaches 00:
  • As xx, which is the score approaches bb, F(x)F(x) which is the probability of the function approaches

Practice Question 1

Imagine you have a light bulb that is expected to last on average 10 hours, and its lifespan is modelled with an exponential distribution. The exponential distribution’s PDF is defined by: f(x)=0.1e0.1xf(x)=0.1e^{0.1x}, for x0x\geq0. Calculate the probability that the light bulb lasts between 9 and 11 hours.

Before we start answering the question, it is best to present all information in a neat order. The question is asking us to calculate the probability between 9 and 11 hours. Thus, we use the format for probability as discussed earlier in the chapter:

P(9X11)P(9≤X≤11)

Now, to find the probability, we must integrate the PDF, which is given in the question.

P(9X11)=9110.1e0.1xdx=[e0.1x]911=e1.1e0.90.54P(9≤X≤11)=\int_9^{11}0.1e^{0.1x}dx\\=[e^{0.1x}]_9^{11}\\=e^{1.1}-e^{0.9}\\\approx0.54

Uniform Continuous distributions

The uniform continuous distribution is a continuous probability distribution where all outcomes are equally likely within a certain range. This means that the continuous distribution is constant, represented graphically using a straight horizontal line for some value. The formula for the PDF and CDF alter slightly when we are dealing with uniform distributions.

The probability density function of a uniform distribution is constant between values aa and bb, and zero everywhere else. The formula for a PDF of a uniform continuous distribution is as follows:

f(x)=1baf(x)=\frac{1}{b-a}

Here, the total area under the PDF curve is 11.

For the cumulative distribution function of a uniform distribution, values increases linearly from 0 to 1 as xx moves from aa to bb. The formula for the CDF is given by:

F(x)=xaba=abf(x)dxF(x)=\frac{x-a}{b-a}=\int_a^bf(x)dx

Practice Question 2

Determine the value for constant mm, that makes the function f(x)=mf(x)=m , a probability density function (PDF), where 0x80\leq x\leq 8. Then find the corresponding cumulative distribution function (CDF)

From the knowledge presented in this chapter, we know that a PDF must be equal to 11. However, as this is a uniform continuous distribution, we can simply implement the formula provided above to determine the PDF.

f(x)=1bam=180=18f(x)=\frac{1}{b-a}\\m=\frac{1}{8-0}\\=\frac{1}{8}

Now, we can determine the CDF of this uniform distribution by integrating the value found for the PDF.

F(x)=0x18dt=[18t]0x=18xF(x)=\int_0^x\frac{1}{8}dt\\=[\frac{1}{8}t]_0^x\\=\frac{1}{8}x

Return to Module 10: Continuous Probability Distributions