Honors Statistics Unit 5 Review: Continuous Random Variables

Key Concepts

• Continuous random variables can take on any value within a specified range or interval
• Probability is represented by the area under the curve of a continuous probability distribution
• The total area under the curve of a continuous probability distribution is always equal to 1
• Continuous distributions are characterized by their probability density functions (PDFs) and cumulative distribution functions (CDFs)
• The expected value (mean) and variance are important measures for describing continuous distributions
  • The expected value represents the average value of the random variable
  • The variance measures the spread or dispersion of the distribution around the mean
• Common continuous distributions include the normal distribution, exponential distribution, and uniform distribution
• Continuous distributions are used to model various real-world phenomena, such as heights, weights, time between events, and measurement errors

Types of Continuous Distributions

• Normal distribution (Gaussian distribution) is a symmetric, bell-shaped curve characterized by its mean and standard deviation
  • Widely used in natural and social sciences due to the central limit theorem
  • Examples include heights, weights, and IQ scores
• Exponential distribution models the time between events in a Poisson process, such as the time between customer arrivals or the lifespan of electronic components
• Uniform distribution has a constant probability density over a specified interval and is used when all values within the interval are equally likely
  • Examples include the position of a randomly stopped spinner on a board game or the waiting time for a bus that arrives at regular intervals
• Beta distribution is a versatile distribution defined on the interval [0, 1] and is used to model proportions or probabilities
• Gamma distribution is used to model waiting times or durations, such as the time required to complete a task or the lifespan of a product
• Chi-square distribution is the distribution of the sum of squared standard normal random variables and is used in hypothesis testing and confidence interval estimation
• Student's t-distribution is similar to the normal distribution but has heavier tails and is used when the sample size is small or the population variance is unknown

Probability Density Functions (PDFs)

• A probability density function (PDF) is a function that describes the relative likelihood of a continuous random variable taking on a specific value
• The PDF is denoted as $f(x)$, where $x$ is the value of the random variable
• The PDF is non-negative for all values of $x$, i.e., $f(x) \geq 0$
• The total area under the curve of a PDF is equal to 1, i.e., $\int_{-\infty}^{\infty} f(x) dx = 1$
• The probability of a continuous random variable falling within an interval $[a, b]$ is given by the area under the PDF curve between $a$ and $b$, i.e., $P(a \leq X \leq b) = \int_{a}^{b} f(x) dx$
• PDFs are used to calculate probabilities, expected values, and other properties of continuous distributions
• Each continuous distribution has its own unique PDF, which is determined by the distribution's parameters (e.g., mean and standard deviation for the normal distribution)

Cumulative Distribution Functions (CDFs)

• A cumulative distribution function (CDF) is a function that gives the probability that a continuous random variable $X$ takes a value less than or equal to a specific value $x$
• The CDF is denoted as $F(x) = P(X \leq x)$
• The CDF is non-decreasing, i.e., if $a \leq b$, then $F(a) \leq F(b)$
• The CDF ranges from 0 to 1, i.e., $0 \leq F(x) \leq 1$
• The probability of a continuous random variable falling within an interval $[a, b]$ can be calculated using the CDF: $P(a \leq X \leq b) = F(b) - F(a)$
  • This is because $P(a \leq X \leq b) = P(X \leq b) - P(X \leq a)$
• The PDF is the derivative of the CDF, i.e., $f(x) = \frac{d}{dx}F(x)$
• The CDF can be obtained by integrating the PDF, i.e., $F(x) = \int_{-\infty}^{x} f(t) dt$

Expected Value and Variance

• The expected value (mean) of a continuous random variable $X$ is denoted as $E(X)$ or $\mu$ and is calculated using the formula $E(X) = \int_{-\infty}^{\infty} x f(x) dx$
  • It represents the average value of the random variable over its entire range
• The variance of a continuous random variable $X$ is denoted as $Var(X)$ or $\sigma^2$ and is calculated using the formula $Var(X) = E((X - \mu)^2) = \int_{-\infty}^{\infty} (x - \mu)^2 f(x) dx$
  • It measures the average squared deviation of the random variable from its mean
• The standard deviation $\sigma$ is the square root of the variance and is used to measure the spread of the distribution
• The expected value and variance are important for characterizing the location and dispersion of a continuous distribution
• For the normal distribution, the expected value is equal to the mean parameter $\mu$, and the variance is equal to the square of the standard deviation parameter $\sigma^2$
• The expected value and variance can be used to standardize a continuous random variable, creating a standard normal distribution with a mean of 0 and a standard deviation of 1

Applications and Real-World Examples

• Normal distribution is used in quality control to model the distribution of product measurements and identify items that fall outside acceptable limits
• Exponential distribution is used to model the time between events in a Poisson process, such as the time between customer arrivals at a store or the time between failures of a machine
• Uniform distribution is used in simulation and modeling to generate random numbers within a specified range, such as generating random coordinates within a rectangular area
• Beta distribution is used in Bayesian inference to model prior and posterior distributions of probabilities or proportions, such as the proportion of defective items in a manufacturing process
• Gamma distribution is used to model waiting times or durations, such as the time required to complete a task or the lifespan of a product, and is also used in queuing theory to model service times
• Chi-square distribution is used in hypothesis testing to compare the variance of a sample to a hypothesized population variance and to test the goodness-of-fit of a categorical distribution
• Student's t-distribution is used in hypothesis testing and confidence interval estimation when the sample size is small or the population variance is unknown, such as in medical research with small sample sizes

Common Mistakes and Misconceptions

• Confusing probability density with probability, as the probability density can be greater than 1, while probability is always between 0 and 1
• Incorrectly calculating probabilities by using the PDF value directly instead of integrating over the desired interval
• Misinterpreting the expected value as the most likely value or the median of the distribution, when it is actually the average value over the entire range
• Assuming that all continuous distributions are symmetric or bell-shaped, when there are many asymmetric continuous distributions (e.g., exponential, gamma)
• Applying properties of discrete random variables to continuous random variables, such as calculating the probability of a specific value (which is always 0 for continuous random variables)
• Misusing the normal distribution for data that is not approximately normally distributed, leading to incorrect conclusions or predictions
• Forgetting to check the assumptions of a continuous distribution before applying it to a real-world problem, such as independence or continuity of the data

Practice Problems and Solutions

1. Given a normal distribution with a mean of 70 and a standard deviation of 5, find the probability that a randomly selected value is between 65 and 75.

   • Solution: $P(65 \leq X \leq 75) = \Phi(\frac{75-70}{5}) - \Phi(\frac{65-70}{5}) = \Phi(1) - \Phi(-1) \approx 0.6827$

2. The time between customer arrivals at a store follows an exponential distribution with a mean of 10 minutes. What is the probability that the time between two consecutive arrivals is less than 5 minutes?

   • Solution: $P(X < 5) = 1 - e^{-\frac{5}{10}} \approx 0.3935$

3. A machine fills bottles with a liquid, and the volume of liquid in each bottle follows a normal distribution with a mean of 500 mL and a standard deviation of 10 mL. What is the probability that a randomly selected bottle contains more than 520 mL of liquid?

   • Solution: $P(X > 520) = 1 - \Phi(\frac{520-500}{10}) = 1 - \Phi(2) \approx 0.0228$

4. The lifespan of a certain type of light bulb follows a gamma distribution with a shape parameter of 3 and a scale parameter of 1000 hours. Find the expected lifespan of a light bulb and the standard deviation of the lifespan.

   • Solution: Expected lifespan = $\alpha\beta = 3 \times 1000 = 3000$ hours, Standard deviation = $\sqrt{\alpha\beta^2} = \sqrt{3 \times 1000^2} \approx 1732$ hours

5. A company produces steel rods, and the length of the rods follows a uniform distribution between 95 cm and 105 cm. If a rod is randomly selected, what is the probability that its length is between 98 cm and 102 cm?

   • Solution: $P(98 \leq X \leq 102) = \frac{102-98}{105-95} = \frac{4}{10} = 0.4$