One-way ANOVA compares means across multiple groups, determining if significant differences exist. It analyzes between-group and within-group variability, using the F-statistic to assess if group means differ significantly.
ANOVA calculations involve degrees of freedom, sum of squares, and mean squares. Post-ANOVA procedures include post-hoc tests like Tukey's HSD and effect size calculations, providing detailed insights into group differences and their magnitude.
ANOVA Basics
Overview of Analysis of Variance (ANOVA)
- ANOVA is a statistical method used to compare means across multiple groups or conditions
- Determines if there are significant differences between the means of three or more independent groups
- Can be used with both experimental and observational data
- Assumes that the dependent variable is normally distributed and the groups have equal variances (homogeneity of variance)
Types of Variability in ANOVA
- Between-group variability
- Measures the differences between the group means
- Reflects the effect of the independent variable on the dependent variable
- Larger between-group variability suggests a significant effect of the independent variable
- Within-group variability
- Measures the differences among scores within each group
- Reflects individual differences and random error
- Smaller within-group variability indicates that the groups are more homogeneous
F-statistic in ANOVA
- The F-statistic is the ratio of between-group variability to within-group variability
- A larger F-statistic indicates a greater difference between group means relative to the variability within groups
- The F-statistic is compared to a critical value from the F-distribution to determine statistical significance
- A significant F-statistic suggests that at least one group mean differs from the others
ANOVA Calculations
Degrees of Freedom in ANOVA
- Degrees of freedom (df) represent the number of independent pieces of information in a dataset
- In one-way ANOVA, there are two types of degrees of freedom:
- Between-group df = number of groups - 1
- Within-group df = total sample size - number of groups
- Degrees of freedom are used to determine the critical F-value and p-value
Sum of Squares in ANOVA
- Sum of squares (SS) measures the total variability in the data
- In one-way ANOVA, there are three types of sum of squares:
- Total SS: total variability in the data
- Between-group SS: variability due to differences between group means
- Within-group SS: variability due to differences within groups
- The total SS is partitioned into between-group SS and within-group SS
Mean Square in ANOVA
- Mean square (MS) is the average variability and is calculated by dividing the sum of squares by the corresponding degrees of freedom
- In one-way ANOVA, there are two types of mean squares:
- Between-group MS = between-group SS / between-group df
- Within-group MS = within-group SS / within-group df
- The F-statistic is calculated by dividing the between-group MS by the within-group MS
Post-ANOVA Procedures
Post-hoc Tests
- Post-hoc tests are conducted after a significant F-statistic to determine which specific group means differ from each other
- These tests control for the increased risk of Type I error (false positives) that occurs when making multiple comparisons
- Common post-hoc tests include Tukey's HSD, Bonferroni correction, and Scheffe's test
- Post-hoc tests provide more detailed information about the nature of the group differences
Tukey's Honestly Significant Difference (HSD)
- Tukey's HSD is a widely used post-hoc test that compares all possible pairs of group means
- It calculates the minimum difference between means that is necessary for significance, taking into account the number of comparisons being made
- Tukey's HSD is more powerful than other post-hoc tests when the sample sizes are equal
- It is a conservative test, meaning it is less likely to find significant differences than some other post-hoc tests (Dunnett's test)
Effect Size in ANOVA
- Effect size measures the magnitude of the difference between groups
- In one-way ANOVA, eta squared (η²) is a common measure of effect size
- η² = between-group SS / total SS
- Eta squared ranges from 0 to 1 and represents the proportion of variance in the dependent variable that is explained by the independent variable
- Interpretation of η² (small effect: 0.01, medium effect: 0.06, large effect: 0.14)
- Reporting effect size alongside statistical significance provides a more complete picture of the results