Introductory Statistics: Probability Random Variables Discrete vs Continuous Probability Distributions Expected Value

What Is This?

Random Variables are functions that map the outcomes of a random phenomenon to real numbers. They can be discrete (countable values) or continuous (uncountable values). This topic appears in exams to test your understanding of different types of random variables, their probability distributions, and how to calculate expected values. Questions typically involve identifying the type of random variable, calculating probabilities, and determining expected values.

Why It Matters

This topic is tested in various statistics and probability exams, including those for mathematics, engineering, economics, and data science. It appears frequently and carries significant marks. It tests your ability to apply statistical concepts to real-world problems, interpret data, and make predictions.

Core Concepts

1. Discrete vs. Continuous Random Variables:
2. Discrete: Countable outcomes (e.g., number of heads in coin tosses).
3. Continuous: Uncountable outcomes (e.g., height of individuals).
4. Probability Distributions:
5. Probability Mass Function (PMF) for discrete variables.
6. Probability Density Function (PDF) for continuous variables.
7. Expected Value: The long-term average value of a random variable, calculated as the sum (or integral) of the product of each outcome and its probability.
8. Cumulative Distribution Function (CDF): Gives the probability that a random variable is less than or equal to a specific value.
9. Variance and Standard Deviation: Measures of the spread of a random variable's values.

Prerequisites

1. Basic Probability: Understanding of events, outcomes, and basic probability rules.
2. Calculus (for continuous variables): Integration and differentiation.
3. Algebra: Solving equations and inequalities.

The Rule-Book (How It Works)

Primary Rule

• Discrete Random Variables: Use PMF to find probabilities.
• Continuous Random Variables: Use PDF and integrate to find probabilities.

Sub-rules and Exceptions

• PMF: Sum of probabilities of all outcomes must equal 1.
• PDF: Area under the curve must equal 1.
• Expected Value: For discrete, ( E(X) = \sum x_i P(X = x_i) ). For continuous, ( E(X) = \int_{-\infty}^{\infty} x f(x) \, dx ).

Visual Pattern

• PMF: Think of a bar graph where each bar's height is the probability of that outcome.
• PDF: Think of a smooth curve where the area under the curve gives the probability.

Exam / Job / Audit Weighting

• Frequency: High
• Difficulty Rating: Intermediate
• Question Type: Multiple choice, short answer, problem-solving

Difficulty Level

Intermediate

Must-Know Rules, Formulas, Standards, or Principles

1. Expected Value for Discrete: ( E(X) = \sum x_i P(X = x_i) )
2. Expected Value for Continuous: ( E(X) = \int_{-\infty}^{\infty} x f(x) \, dx )
3. Variance for Discrete: ( \text{Var}(X) = E(X^2) - (E(X))^2 )

Worked Examples (Step-by-Step)

Easy

Question: A fair die is rolled. Let ( X ) be the outcome. Find ( E(X) ).
Step-by-Step: 1. Identify possible outcomes: 1, 2, 3, 4, 5, 6.
2. Each outcome has a probability of ( \frac{1}{6} ).
3. Calculate ( E(X) ):
[
E(X) = 1 \times \frac{1}{6} + 2 \times \frac{1}{6} + 3 \times \frac{1}{6} + 4 \times \frac{1}{6} + 5 \times \frac{1}{6} + 6 \times \frac{1}{6} = 3.5
] Answer: ( E(X) = 3.5 )

Medium

Question: A random variable ( X ) has the PDF ( f(x) = 2x ) for ( 0 \leq x \leq 1 ). Find ( E(X) ).
Step-by-Step: 1. Identify the PDF: ( f(x) = 2x ).
2. Calculate ( E(X) ):
[
E(X) = \int_{0}^{1} x \cdot 2x \, dx = \int_{0}^{1} 2x^2 \, dx = \left[ \frac{2x^3}{3} \right]_{0}^{1} = \frac{2}{3}
] Answer: ( E(X) = \frac{2}{3} )

Hard

Question: A random variable ( X ) has the PMF ( P(X = x) = \frac{x}{10} ) for ( x = 1, 2, 3, 4 ). Find ( \text{Var}(X) ).
Step-by-Step: 1. Identify the PMF: ( P(X = x) = \frac{x}{10} ).
2. Calculate ( E(X) ):
[
E(X) = 1 \times \frac{1}{10} + 2 \times \frac{2}{10} + 3 \times \frac{3}{10} + 4 \times \frac{4}{10} = 3
] 3. Calculate ( E(X^2) ):
[
E(X^2) = 1^2 \times \frac{1}{10} + 2^2 \times \frac{2}{10} + 3^2 \times \frac{3}{10} + 4^2 \times \frac{4}{10} = 10
] 4. Calculate ( \text{Var}(X) ):
[
\text{Var}(X) = E(X^2) - (E(X))^2 = 10 - 3^2 = 1
] Answer: ( \text{Var}(X) = 1 )

Common Exam Traps & Mistakes

1. Mistake: Forgetting to check if the PMF sums to 1.
2. Wrong Answer: A PMF that sums to more or less than 1.
3. Correct Approach: Always verify that the sum of probabilities equals 1.
4. Mistake: Not integrating correctly for continuous variables.
5. Wrong Answer: Incorrect expected value due to wrong integration.
6. Correct Approach: Double-check your integration limits and steps.
7. Mistake: Confusing discrete and continuous variables.
8. Wrong Answer: Using PMF for continuous variables.
9. Correct Approach: Identify the type of variable and use the correct function.
10. Mistake: Forgetting to calculate ( E(X^2) ) for variance.
11. Wrong Answer: Incorrect variance calculation.
12. Correct Approach: Always calculate ( E(X^2) ) separately.

Shortcut Strategies & Exam Hacks

1. Memory Aid: Remember "PMF for discrete, PDF for continuous."
2. Elimination Strategy: If a PMF doesn't sum to 1, eliminate that option.
3. Pattern Recognition: For uniform distributions, the expected value is the midpoint.
4. Formula Shortcut: For symmetric distributions, the expected value is the center of symmetry.

Question-Type Taxonomy

1. Multiple Choice: Identify the type of random variable.
2. Example: A random variable ( X ) has possible values 1, 2, 3. What type of random variable is ( X )?
3. Favored by: GRE, GMAT
4. Short Answer: Calculate the expected value.
5. Example: Given the PMF ( P(X = x) = \frac{x}{6} ) for ( x = 1, 2, 3 ), find ( E(X) ).
6. Favored by: University exams
7. Problem-Solving: Determine the variance.
8. Example: A continuous random variable ( X ) has the PDF ( f(x) = 3x^2 ) for ( 0 \leq x \leq 1 ). Find ( \text{Var}(X) ).
9. Favored by: Advanced statistics exams

Practice Set (MCQs)

Question 1

Question: A random variable ( X ) has the PMF ( P(X = x) = \frac{x}{15} ) for ( x = 1, 2, 3, 4, 5 ). What is ( E(X) )? Options: A. 2 B. 3 C. 4 D. 5 Correct Answer: B. 3 Explanation: Calculate ( E(X) ): [ E(X) = 1 \times \frac{1}{15} + 2 \times \frac{2}{15} + 3 \times \frac{3}{15} + 4 \times \frac{4}{15} + 5 \times \frac{5}{15} = 3 ] Why the Distractors Are Tempting: - A: Sum of probabilities is correct but values are wrong.
- C: Close to the correct value but slightly off.
- D: Sum of probabilities is incorrect.

Question 2

Question: A continuous random variable ( X ) has the PDF ( f(x) = \frac{3}{8}(2 - x) ) for ( 0 \leq x \leq 2 ). What is ( E(X) )? Options: A. 0.5 B. 1 C. 1.5 D. 2 Correct Answer: B. 1 Explanation: Calculate ( E(X) ): [ E(X) = \int_{0}^{2} x \cdot \frac{3}{8}(2 - x) \, dx = \int_{0}^{2} \frac{3}{8}(2x - x^2) \, dx = \left[ \frac{3}{8}(x^2 - \frac{x^3}{3}) \right]_{0}^{2} = 1 ] Why the Distractors Are Tempting: - A: Incorrect integration limits.
- C: Incorrect integration steps.
- D: Incorrect PDF.

Question 3

Question: A random variable ( X ) has the PMF ( P(X = x) = \frac{x}{10} ) for ( x = 1, 2, 3, 4 ). What is ( \text{Var}(X) )? Options: A. 0.5 B. 1 C. 1.5 D. 2 Correct Answer: B. 1 Explanation: Calculate ( E(X) ) and ( E(X^2) ): [ E(X) = 1 \times \frac{1}{10} + 2 \times \frac{2}{10} + 3 \times \frac{3}{10} + 4 \times \frac{4}{10} = 3 ] [ E(X^2) = 1^2 \times \frac{1}{10} + 2^2 \times \frac{2}{10} + 3^2 \times \frac{3}{10} + 4^2 \times \frac{4}{10} = 10 ] [ \text{Var}(X) = E(X^2) - (E(X))^2 = 10 - 3^2 = 1 ] Why the Distractors Are Tempting: - A: Incorrect ( E(X^2) ) calculation.
- C: Incorrect ( E(X) ) calculation.
- D: Incorrect variance formula.

Question 4

Question: A continuous random variable ( X ) has the PDF ( f(x) = 2x ) for ( 0 \leq x \leq 1 ). What is ( \text{Var}(X) )? Options: A. (\frac{1}{9}) B. (\frac{1}{18}) C. (\frac{1}{12}) D. (\frac{1}{6}) Correct Answer: B. (\frac{1}{18}) Explanation: Calculate ( E(X) ) and ( E(X^2) ): [ E(X) = \int_{0}^{1} x \cdot 2x \, dx = \int_{0}^{1} 2x^2 \, dx = \left[ \frac{2x^3}{3} \right]{0}^{1} = \frac{2}{3} ] [ E(X^2) = \int ] [ \text{Var}(X) = E(X^2) - (E(X))^2 = \frac{1}{2} - \left(\frac{2}{3}\right)^2 = \frac{1}{18} ] }^{1} x^2 \cdot 2x \, dx = \int_{0}^{1} 2x^3 \, dx = \left[ \frac{2x^4}{4} \right]_{0}^{1} = \frac{1}{2Why the Distractors Are Tempting: - A: Incorrect ( E(X^2) ) calculation.
- C: Incorrect ( E(X) ) calculation.
- D: Incorrect variance formula.

Question 5

Question: A random variable ( X ) has the PMF ( P(X = x) = \frac{x}{6} ) for ( x = 1, 2, 3 ). What is ( E(X) )? Options: A. 1.5 B. 2 C. 2.5 D. 3 Correct Answer: B. 2 Explanation: Calculate ( E(X) ): [ E(X) = 1 \times \frac{1}{6} + 2 \times \frac{2}{6} + 3 \times \frac{3}{6} = 2 ] Why the Distractors Are Tempting: - A: Incorrect PMF values.
- C: Incorrect sum of probabilities.
- D: Incorrect expected value calculation.

30-Second Cheat Sheet

• Discrete vs. Continuous: PMF for discrete, PDF for continuous.
• Expected Value: ( E(X) = \sum x_i P(X = x_i) ) for discrete, ( E(X) = \int_{-\infty}^{\infty} x f(x) \, dx ) for continuous.
• Variance: ( \text{Var}(X) = E(X^2) - (E(X))^2 ).
• PMF Sum: Must equal 1.
• PDF Area: Must equal 1.
• Uniform Distribution: Expected value is the midpoint.
• Symmetric Distribution: Expected value is the center of symmetry.

Learning Path

1. Beginner Foundation: Understand basic probability and calculus.
2. Core Rules: Learn PMF, PDF, expected value, and variance formulas.
3. Practice: Solve simple problems to apply formulas.
4. Timed Drills: Practice under exam conditions.
5. Mock Tests: Take full-length practice exams.

Related Topics

1. Probability Theory: Understanding events and outcomes.
2. Relation: Provides the foundation for random variables.
3. Statistical Inference: Making predictions based on sample data.
4. Relation: Uses random variables and distributions.
5. Hypothesis Testing: Testing claims about population parameters.
6. Relation: Involves random variables and their distributions.