3.2 Independent and Mutually Exclusive Events

Independent and Mutually Exclusive Events

Probability events can be independent or mutually exclusive, but almost never both. Independent events don't affect each other's likelihood, while mutually exclusive events can't happen at the same time. Keeping these two concepts straight is essential for choosing the right formula when calculating probabilities.

Sampling method also matters here. Whether you replace items between draws determines whether events stay independent or not. These ideas set the stage for more advanced tools like the Law of Total Probability and Bayes' Theorem.

more resources to help you study

practice questions

Independence vs. Mutual Exclusivity

Independent events occur when the outcome of one event has no effect on the probability of another. Rolling a 6 on a die and then flipping heads on a coin are independent because the die result doesn't change the coin's behavior.

Two key properties define independence:

• The probability of both events occurring is the product of their individual probabilities: $P(A \cap B) = P(A) \times P(B)$
• The conditional probability stays unchanged: $P(A|B) = P(A)$ and $P(B|A) = P(B)$

Mutually exclusive events cannot happen at the same time. Drawing a heart or drawing a spade on a single draw from a deck are mutually exclusive because one card can't be both suits.

Two key properties define mutual exclusivity:

• The probability of both occurring simultaneously is zero: $P(A \cap B) = 0$
• The probability of either occurring is the simple sum of their probabilities: $P(A \cup B) = P(A) + P(B)$

A common mistake is confusing these two concepts. Notice that they actually conflict with each other in most cases. If two events are mutually exclusive ($P(A \cap B) = 0$), the multiplication rule for independence ($P(A \cap B) = P(A) \times P(B)$) can only hold if at least one event has probability zero. So for events that can actually happen, independent and mutually exclusive are incompatible.

Venn diagrams help visualize the difference. Independent events have overlapping circles where the overlap area equals $P(A) \times P(B)$. Mutually exclusive events have circles that don't overlap at all.

Sampling With and Without Replacement

The sampling method you use directly determines whether successive draws are independent.

With replacement means you put each selected item back before drawing again. This keeps the pool of items identical for every draw.

• Each selection is independent of every other selection.
• Probabilities stay constant. If a bag has 3 red marbles out of 10, the probability of drawing red is $\frac{3}{10}$ on every single draw.

Without replacement means selected items stay out. This changes the composition of the remaining pool after each draw.

• Probabilities shift after each selection. If you draw a heart from a 52-card deck and don't replace it, the probability of drawing another heart drops from $\frac{13}{52}$ to $\frac{12}{51}$.
• Events are no longer independent because earlier outcomes affect later probabilities.

For without-replacement problems where you need the probability of getting exactly $k$ successes in $n$ draws, use the hypergeometric probability formula:

$P(X = k) = \frac{{K \choose k}{N-K \choose n-k}}{{N \choose n}}$

Where:

• $N$ = total items in the population (e.g., 52 cards)
• $K$ = items with the desired characteristic (e.g., 13 hearts)
• $n$ = number of items drawn (e.g., a 5-card hand)
• $k$ = desired number of successes in the sample (e.g., exactly 2 hearts)

This formula counts the favorable combinations divided by total combinations, which is why it works specifically for sampling without replacement.

Classifying Probability Events

When you're given a problem and need to determine the relationship between two events, follow these checks.

To test for independence, verify either of these equivalent conditions:

1. $P(A|B) = P(A)$ (knowing B happened doesn't change A's probability)
2. $P(A \cap B) = P(A) \times P(B)$

If either condition holds, both hold, and the events are independent. For example, drawing a king and then drawing a heart from a deck with replacement are independent because replacing the first card resets the deck.

To test for mutual exclusivity, check:

1. Can both events physically occur at the same time?
2. Is $P(A \cap B) = 0$?

If yes to both, the events are mutually exclusive. Drawing a king or drawing a queen on a single draw are mutually exclusive because one card can't be both.

A practical tip: always start by asking whether the events can co-occur. If they can, they're not mutually exclusive. Then check the multiplication rule to see if they're independent. Don't assume either property from context alone; verify with the numbers.

Advanced Probability Concepts

These topics build directly on independence and mutual exclusivity:

• Law of Total Probability: Calculates the probability of an event by breaking it into separate, mutually exclusive scenarios and summing across all of them. You'll use this when an outcome can happen through multiple distinct pathways.
• Bayes' Theorem: Lets you update a probability after learning new information. It connects a prior probability (what you believed before) to a posterior probability (what you believe after new evidence). This relies on understanding conditional probability and independence.

Both of these tools assume you can correctly identify whether events are independent or mutually exclusive, which is why getting comfortable with classification now pays off later.