---
title: "Post-Hoc Analysis | Honors Statistics"
description: "Post-hoc analysis in Honors Statistics is extra comparison work done after a significant test, often with chi-square results, to find which groups differ."
canonical: "https://fiveable.me/honors-statistics/key-terms/post-hoc-analysis"
type: "key-term"
subject: "Honors Statistics"
unit: "Unit 11"
---

# Post-Hoc Analysis | Honors Statistics

## Definition

Post-hoc analysis is the follow-up checking you do after a significant statistical test to see which groups or cells are driving the result. In Honors Statistics, it often comes up after chi-square tests of independence or homogeneity.

## What It Is

Post-hoc analysis in Honors Statistics is the set of follow-up comparisons you make after an overall test tells you there is a difference somewhere, but not exactly where. The main test gives you the big picture, and the post-hoc step zooms in on the groups, categories, or cells that may be causing the result.

This usually shows up after a chi-square test of independence or a chi-square test for homogeneity. If the overall chi-square test is significant, that means the observed counts are not matching the expected pattern well enough to blame on random chance alone. A post-hoc analysis asks the next question: which part of the table is doing the heavy lifting?

You might look at specific cells, compare categories pair by pair, or inspect standardized residuals to see where the observed frequency is much larger or smaller than expected. That helps you move from a general statement like “there is an association” to a more precise statement like “the association seems to come mostly from one or two category combinations.”

The catch is that every extra comparison adds more chances of a false alarm. If you test many groups without adjusting anything, your familywise error rate goes up, which means you are more likely to call something significant just by luck. That is why post-hoc work often uses a correction such as the Bonferroni correction to make the cutoff more strict.

A simple way to think about it is this: the initial test is the alarm, and the post-hoc analysis is the investigation. The alarm tells you something unusual happened, but the investigation figures out where the unusual pattern lives. In a class problem, that means you do not stop at “significant chi-square result,” you keep going and interpret the specific categories carefully.

Post-hoc analysis is not random searching. It should follow a logical result from the original test and answer a focused question about the data. If you start with a long list of comparisons and no plan, you are much more likely to overread noise as a real effect.

## Why It Matters

Post-hoc analysis matters because Honors Statistics is not just about getting a p-value, it is about explaining what the data actually says. A significant chi-square test tells you there is some kind of pattern, but it does not automatically tell you which categories are responsible. Without the follow-up step, your interpretation stays vague.

This is especially useful in contingency tables with several rows or columns. For example, if a survey of study method by grade level gives a significant chi-square result, the post-hoc question might be whether one grade level uses a certain method much more than expected, or whether one category is much less common than the others. That turns a broad association into a more useful class conclusion.

It also connects directly to inference discipline. Statistics is full of temptations to keep checking more and more comparisons until something looks significant. Post-hoc analysis forces you to think about error control, especially the familywise error rate. That habit shows up in written explanations, FRQ-style reasoning, and any problem where you have to justify why a comparison is trustworthy.

If you can read post-hoc output well, you can explain the story behind the table instead of just reporting the test statistic. That is a big step in this course, because the goal is not only to run procedures, but to interpret results in context.

## Connections

### Bonferroni Correction

This is one of the most common ways to adjust post-hoc comparisons. Since each extra test raises the chance of a false positive, the Bonferroni correction makes the significance level smaller for each individual comparison. In practice, that means fewer results count as significant, but the ones that do are harder to dismiss as random chance.

### Familywise Error Rate

Post-hoc analysis is tightly connected to familywise error rate because multiple comparisons change the odds of making at least one Type I error. If you test many pairs or many cells, the overall chance of a false alarm goes up even if each test looks reasonable on its own. Post-hoc adjustments exist to keep that overall risk under control.

### [Standardized Residuals](/honors-statistics/key-terms/standardized-residuals)

These are often used to spot which cells in a chi-square table are far from what you would expect. A large positive or negative residual can point to the categories driving the significant result. In a post-hoc analysis, residuals give you a fast way to see where the pattern is strongest without testing every possible comparison blindly.

### Planned Comparisons

Planned comparisons are decided before you look at the data, while post-hoc analysis happens after an overall result suggests something interesting. That difference matters because planned comparisons usually come with a clearer research question and less fishing around. Post-hoc work is more exploratory, so it needs more caution with error rates.

## On the AP Exam

A chi-square problem often gives you a significant test statistic and then asks what to do next. That is where post-hoc analysis comes in: you identify which cells, groups, or category comparisons deserve a closer look and explain the pattern in words.

On a free-response or quiz item, you might be given a contingency table and asked to interpret the source of the association. A strong answer does not just say “the result is significant.” It points to the relevant row or column totals, notes where observed frequencies differ from expected frequencies, and, if needed, mentions a correction such as Bonferroni before claiming any individual comparison is significant.

When your teacher gives an output table from software like SPSS, you may need to read the post-hoc section and decide which categories stand out. The task is usually interpretation, not calculation. You are showing that you can move from the global test to the specific pattern in the data without overclaiming.

## Post-Hoc Analysis vs Planned Comparisons

These sound similar, but they are not the same move. Planned comparisons are chosen before the data analysis because you already have specific pairs or groups in mind, while post-hoc analysis comes after a significant overall test and explores where the difference seems to be. If the comparison was not planned in advance, it belongs in post-hoc territory.

## Key Takeaways

- Post-hoc analysis is the follow-up step after an overall test shows a significant difference somewhere in the data.
- In Honors Statistics, it is most often used after chi-square tests to find which groups or cells are driving the result.
- The point is to move from a general conclusion to a more specific one without guessing from the table.
- Because multiple comparisons raise the chance of a Type I error, post-hoc work often uses an adjustment such as the Bonferroni correction.
- A good post-hoc interpretation names the pattern in context instead of just repeating that the result was significant.

## FAQs

### What is post-hoc analysis in Honors Statistics?

It is the extra analysis you do after a significant test to figure out where the pattern is coming from. In this course, that usually means looking more closely at a chi-square table to see which groups or cells differ from what you would expect.

### When do you use post-hoc analysis?

You use it after an overall test suggests there is a difference, but the test does not tell you exactly where that difference is. It is common after chi-square tests of independence or homogeneity when you need to identify the specific categories driving the result.

### Is post-hoc analysis the same as planned comparisons?

No. Planned comparisons are chosen before the data analysis because they answer a question you already had in mind. Post-hoc analysis happens after the data show a significant result, so it is more exploratory and usually needs stronger error control.

### Why do post-hoc tests need corrections like Bonferroni?

Because each extra comparison adds another chance of a false positive. A correction like Bonferroni lowers the cutoff for each test so your overall chance of a Type I error stays closer to the level you intended.

## Related Study Guides

- [11.3 Test of Independence](/honors-statistics/unit-11/3-test-independence/study-guide/34n9wbbf1AvDDjPk)
- [11.4 Test for Homogeneity](/honors-statistics/unit-11/4-test-homogeneity/study-guide/8VEAg342mykcOJxn)

## About This Document

Canonical Fiveable pages are available as Markdown at the same path plus `.md`.

- [llms.txt](https://fiveable.me/llms.txt): index of Fiveable's sections and URL patterns
- [llms-full.txt](https://fiveable.me/llms-full.txt): complete subject and unit listing
- [MCP server](https://fiveable.me/mcp): call Fiveable as tools instead of fetching pages (`https://fiveable.me/api/mcp`)
- [MCP server for AP teachers](https://fiveable.me/mcp/teachers): a teacher's classes, assignments and AP-rubric grading (`https://fiveable.me/api/mcp/teacher`)

## Structured Data

```json
{"@context":"https://schema.org","@graph":[{"@type":"LearningResource","@id":"https://fiveable.me/honors-statistics/key-terms/post-hoc-analysis#resource","name":"Post-Hoc Analysis | Honors Statistics","url":"https://fiveable.me/honors-statistics/key-terms/post-hoc-analysis","learningResourceType":"Concept explainer","educationalLevel":"AP® / High School","about":{"@id":"https://fiveable.me/honors-statistics/key-terms/post-hoc-analysis#term"},"audience":{"@type":"EducationalAudience","educationalRole":"student"},"dateModified":"2026-07-03T02:21:56.957Z","isPartOf":{"@type":"Collection","name":"Honors Statistics Key Terms","url":"https://fiveable.me/honors-statistics/key-terms"},"publisher":{"@type":"Organization","name":"Fiveable","url":"https://fiveable.me"}},{"@type":"DefinedTerm","@id":"https://fiveable.me/honors-statistics/key-terms/post-hoc-analysis#term","name":"Post-Hoc Analysis","description":"Post-hoc analysis is the follow-up checking you do after a significant statistical test to see which groups or cells are driving the result. In Honors Statistics, it often comes up after chi-square tests of independence or homogeneity.","url":"https://fiveable.me/honors-statistics/key-terms/post-hoc-analysis","inDefinedTermSet":{"@type":"DefinedTermSet","name":"Honors Statistics Key Terms","url":"https://fiveable.me/honors-statistics/key-terms"}},{"@type":"FAQPage","mainEntity":[{"@type":"Question","name":"What is post-hoc analysis in Honors Statistics?","acceptedAnswer":{"@type":"Answer","text":"It is the extra analysis you do after a significant test to figure out where the pattern is coming from. In this course, that usually means looking more closely at a chi-square table to see which groups or cells differ from what you would expect."}},{"@type":"Question","name":"When do you use post-hoc analysis?","acceptedAnswer":{"@type":"Answer","text":"You use it after an overall test suggests there is a difference, but the test does not tell you exactly where that difference is. It is common after chi-square tests of independence or homogeneity when you need to identify the specific categories driving the result."}},{"@type":"Question","name":"Is post-hoc analysis the same as planned comparisons?","acceptedAnswer":{"@type":"Answer","text":"No. Planned comparisons are chosen before the data analysis because they answer a question you already had in mind. Post-hoc analysis happens after the data show a significant result, so it is more exploratory and usually needs stronger error control."}},{"@type":"Question","name":"Why do post-hoc tests need corrections like Bonferroni?","acceptedAnswer":{"@type":"Answer","text":"Because each extra comparison adds another chance of a false positive. A correction like Bonferroni lowers the cutoff for each test so your overall chance of a Type I error stays closer to the level you intended."}}]},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Honors Statistics","item":"https://fiveable.me/honors-statistics"},{"@type":"ListItem","position":2,"name":"Key Terms","item":"https://fiveable.me/honors-statistics/key-terms"},{"@type":"ListItem","position":3,"name":"Unit 11","item":"https://fiveable.me/honors-statistics/unit-11"},{"@type":"ListItem","position":4,"name":"Post-Hoc Analysis"}]}]}
```