6.5 Interpreting p-Values

A p-value is the probability of getting a sample result as extreme or more extreme than the one you observed, assuming the null hypothesis is true. A small p-value means your data would be unusual if the null were true, which is evidence for the alternative.

P-Value Interpretation for AP Statistics

The AP Stats wording to remember is: a p-value is the probability of getting a test statistic as extreme or more extreme than the observed value, assuming the null hypothesis and probability model are true. For a one-proportion z-test, that means assuming the true population proportion equals the null value, $p_0$.

A correct interpretation must name the context, describe "as extreme or more extreme," and include the null assumption. A small p-value gives convincing evidence for the alternative hypothesis, but it does not prove the null is false or tell you the probability that $H_0$ is true.

more resources to help you study

practice multiple choiceFRQ practice & scoringcheatsheetsscore calculatorkey terms

Why This Matters for the AP Statistics Exam

Interpreting p-values is at the center of significance testing for proportions, which is a heavily tested part of Unit 6. You will need to compute a z-statistic, find a p-value, and write a correct interpretation in context. The phrasing matters: a strong interpretation always references "as extreme or more extreme" and "assuming the null hypothesis is true." Getting this language right is important for clear exam work on both multiple-choice questions and any test you carry out.

Key Takeaways

• A p-value measures how likely your observed result (or something more extreme) is, assuming the null hypothesis is true.
• The direction of the alternative hypothesis decides whether you use the upper tail, lower tail, or both tails.
• Small p-values give evidence against the null and support the alternative. Large p-values do not prove the null is true.
• The test statistic for a proportion is $z = \dfrac{\hat{p} - p_0}{\sqrt{p_0(1-p_0)/n}}$.
• A good interpretation states the p-value in context and mentions that it assumes the true proportion equals the null value.
• A small p-value alone does not prove sampling bias or random chance is ruled out, but with a random sample it points to the null value being wrong.

What is a p-value?

The p-value is the probability of obtaining a test statistic as extreme or more extreme than the one you observed, under the assumption that the null hypothesis is true. Put another way, it is the proportion of possible samples of a given size that would produce a result at least as far from the null value as your sample did.

It helps you decide whether your observed results are statistically significant.

• If the p-value is small, your observed sample would be unlikely by chance alone if the null were true, which is evidence against the null hypothesis.
• If the p-value is large, your observed sample is not unusual under the null, so it does not provide strong evidence against the null hypothesis.

The p-value is the proportion of values in the null distribution that are as extreme or more extreme than the observed value of the test statistic:

1. The proportion at or above the observed test statistic, if the alternative is >.
2. The proportion at or below the observed test statistic, if the alternative is <.
3. For a ≠ alternative, the proportion less than or equal to the negative of the absolute value of the test statistic plus the proportion greater than or equal to the absolute value of the test statistic.

The test statistic for a one-sample proportion is:

$z = \frac{\hat{p} - p_0}{\sqrt{p_0(1-p_0)/n}}$

where $\hat{p}$ is the sample proportion, $p_0$ is the null hypothesized value, and $n$ is the sample size.

How do we interpret a p-value?

A low p-value means your sample result would be unlikely to occur by random chance if the null hypothesis were true. That could happen for one of three reasons:

1. Legitimate random chance. (Someone wins the lottery now and then.)
2. Some form of sampling bias. (This is why you check that your sample is random before running a significance test.)
3. The value stated in the null hypothesis is actually false. This is the possibility your test is designed to investigate.

If you used a random sample, you can rule out obvious sampling bias. Repeating the study and getting consistent results makes pure chance less believable. When chance and bias are unlikely, that points toward the null value being wrong.

Always remember that the p-value is computed by assuming the null hypothesis and probability model are true, meaning the true population proportion equals the value stated in the null. So a correct interpretation has to keep that assumption front and center.

For example, in a one-sample proportion test, the null hypothesis states that the true population proportion equals a specific value. A small p-value suggests the observed sample proportion is far enough from that value to provide evidence against the null, so you would conclude the true proportion is likely different from the hypothesized value. A large p-value suggests the observed proportion is not unusual under the null, so there is insufficient evidence to reject it. That does not prove the null is true.

How to Use This on the AP Statistics Exam

Free Response

When you carry out a test, do not stop at the number. Write a sentence that connects the p-value back to the context and the assumption behind it. A reliable template:

"Assuming the true proportion is [p_0], there is a [p-value] probability of getting a sample proportion as extreme or more extreme than [p-hat] just by random chance."

Problem Solving

• Compute the z-statistic first using $z = \dfrac{\hat{p} - p_0}{\sqrt{p_0(1-p_0)/n}}$.
• Match the tail to the alternative: upper tail for >, lower tail for <, both tails for ≠.
• For a two-sided test, find the area in one tail and double it.
• Use a normal model only after checking that $np_0 \ge 10$ and $n(1-p_0) \ge 10$ along with the independence condition.

Common Trap

A p-value is not the probability that the null hypothesis is true. It is a probability about the data, calculated while assuming the null is true. Keep that order straight in every interpretation.

Example

In a recent issue of Sports Unlimited, Jackie reads that a right-handed hockey player scores on about 5% of their shots. To test this claim, Jackie watches 15 random hockey games and records 921 shots from random right-handed players. They scored on 60 of those shots. After calculating her z-score and p-value, she finds a p-value of about 0.017. Interpret this p-value.

This p-value means that of all possible samples of 921 shots from right-handed players, about 1.7% of those samples would have a scoring proportion as high or higher than what Jackie observed, assuming the true scoring rate really is 5%. Since her sample was random, there is no obvious sampling bias. It could be that Jackie happened to watch unusually accurate players, which she could check by repeating the study. The other possibility is that the true scoring rate is actually higher than 5%.

Practice Problem

A political campaign wants to know whether the proportion of registered voters in their district who support their candidate is different from the national proportion of 50%. They randomly sample 1000 registered voters and ask whether they support the candidate. They find that 540 of the 1000 respondents support the candidate.

a) Write the null and alternative hypotheses for this scenario.

b) After conducting a one-sample z-test, the p-value is 0.031. Based on the results and the p-value, what can the campaign conclude about the proportion of registered voters in the district who support their candidate? What are the limitations of this conclusion?

Answer

a) Null hypothesis: The proportion of registered voters in the district who support the candidate equals the national proportion of 50%.

H0: p = 0.50

Alternative hypothesis: The proportion of registered voters in the district who support the candidate is different from the national proportion of 50%.

Ha: p ≠ 0.50

b) Because the p-value of 0.031 is smaller than the common significance level of 0.05, the campaign has sufficient evidence to conclude that the district proportion is significantly different from the national proportion of 50%.

Since the sample proportion (0.540) is above 0.50, this points toward more support in the district than nationally. Keep two limitations in mind. First, this conclusion assumes the null hypothesis (true proportion equals 0.50) when computing the p-value, and statistical significance does not prove the difference is large or practically important. Second, the conclusion only generalizes if the sample was truly random and the conditions for the test were met.

Common Misconceptions

• "The p-value is the probability the null hypothesis is true." No. The p-value is the probability of data as extreme or more extreme, calculated while assuming the null is true.
• "A large p-value proves the null hypothesis." It does not. A large p-value only means you lack evidence against the null, not that the null is correct.
• "A small p-value means a big or important effect." Statistical significance is about how unusual the data are under the null, not about the size of the effect. Always separate statistical significance from practical significance.
• "The p-value tells you the chance your result happened by chance." It is more precise than that: it is the chance of a result this extreme or more extreme specifically when the null is assumed true.
• "You can pick the tail however you want." The alternative hypothesis sets the direction. Use the upper tail for >, the lower tail for <, and both tails for ≠.

z-test, say that the true population proportion is assumed to equal $p_0$.

What does a small p-value mean?

A small p-value means the observed result would be unusual if the null hypothesis were true. That gives evidence against $H_0$ and in favor of the alternative hypothesis.

Does a p-value tell you the probability that the null hypothesis is true?

No. A p-value is calculated assuming the null hypothesis is true. It is a probability about the data, not a probability that $H_0$ is true.

How do you use a p-value to make a decision?

Compare the p-value to the significance level, $\alpha$. If the p-value is less than or equal to $\alpha$, reject $H_0$. If the p-value is greater than $\alpha$, fail to reject $H_0$.

What is the common AP Stats mistake with p-values?

The most common mistake is saying the p-value is the chance that the null hypothesis is true. Another common mistake is writing a conclusion without context or without saying the result is calculated under the null assumption.

Related AP Statistics Guides

• Unit 6 Overview: Inference for Categorical Data: Proportions
• 6.2 Constructing a Confidence Interval for a Population Proportion
• 6.1 Introducing Statistics: Why Be Normal?
• 6.4 Setting Up a Test for a Population Proportion
• 6.3 Justifying a Claim Based on a Confidence Interval for a Population Proportion
• 6.8 Confidence Intervals for the Difference of Two Proportions