Honors Statistics Unit 9 Review: Hypothesis Testing with One Sample

Key Concepts and Definitions

• Hypothesis testing evaluates claims or conjectures about a population parameter using sample data
• Null hypothesis ($H_0$) represents a claim of "no effect" or "no difference" and is assumed true unless there is strong evidence against it
• Alternative hypothesis ($H_a$ or $H_1$) represents a claim of "an effect" or "a difference" and is the hypothesis that the researcher wants to support
• Type I error (denoted by $\alpha$) occurs when rejecting a true null hypothesis
  • Also known as a false positive or significance level
• Type II error (denoted by $\beta$) occurs when failing to reject a false null hypothesis
  • Also known as a false negative
• Power is the probability of correctly rejecting a false null hypothesis (calculated as $1-\beta$)
• Test statistic is a standardized value calculated from the sample data used to determine whether to reject the null hypothesis
• P-value measures the strength of evidence against the null hypothesis and represents the probability of observing a test statistic as extreme as the one calculated, assuming the null hypothesis is true

Steps in Hypothesis Testing

1. State the null and alternative hypotheses
   • Determine the claim or conjecture to be tested
   • Formulate the null hypothesis ($H_0$) and the alternative hypothesis ($H_a$ or $H_1$)
2. Choose the significance level ($\alpha$)
   • Commonly used significance levels are 0.01, 0.05, and 0.10
3. Select the appropriate test statistic and sampling distribution
   • Determine the suitable test statistic based on the type of data, sample size, and population distribution
   • Identify the sampling distribution of the test statistic under the null hypothesis
4. Determine the critical value(s) or rejection region
   • Use the sampling distribution and significance level to find the critical value(s)
   • Establish the rejection region based on the alternative hypothesis (one-tailed or two-tailed)
5. Compute the test statistic using the sample data
   • Calculate the value of the test statistic based on the sample data and the chosen formula
6. Make a decision and interpret the results
   • Compare the test statistic to the critical value(s) or calculate the p-value
   • If the test statistic falls in the rejection region or the p-value is less than the significance level, reject the null hypothesis; otherwise, fail to reject the null hypothesis
   • Interpret the results in the context of the problem and draw conclusions

Null and Alternative Hypotheses

• The null hypothesis ($H_0$) states that there is no significant difference or effect
  • Example: $H_0: \mu = 100$ (the population mean is equal to 100)
• The alternative hypothesis ($H_a$ or $H_1$) states that there is a significant difference or effect
  • Example: $H_a: \mu \neq 100$ (the population mean is not equal to 100)
• Alternative hypotheses can be one-tailed or two-tailed
  • One-tailed: $H_a: \mu < 100$ or $H_a: \mu > 100$
  • Two-tailed: $H_a: \mu \neq 100$
• The choice of the alternative hypothesis depends on the research question and prior knowledge
• The null and alternative hypotheses are mutually exclusive and exhaustive, meaning that one and only one of them can be true

Types of Errors and Power

• Type I error ($\alpha$) is the probability of rejecting a true null hypothesis
  • Controlled by the researcher when choosing the significance level
  • Lower significance levels reduce the risk of Type I errors but increase the risk of Type II errors
• Type II error ($\beta$) is the probability of failing to reject a false null hypothesis
  • Affected by factors such as sample size, effect size, and significance level
• Power ($1-\beta$) is the probability of correctly rejecting a false null hypothesis
  • Higher power indicates a greater likelihood of detecting a true effect or difference
  • Increasing sample size, using a larger significance level, or focusing on larger effect sizes can increase power
• The relationship between Type I error, Type II error, and power is important in designing and interpreting hypothesis tests
  • Balancing these factors helps ensure reliable and meaningful results

Test Statistics and Critical Values

• Test statistics are calculated from sample data to determine whether to reject the null hypothesis
• The choice of test statistic depends on the type of data, sample size, and population distribution
  • Example: Z-statistic for large samples (n > 30) with known population standard deviation
  • Example: T-statistic for small samples (n ≤ 30) or unknown population standard deviation
• Critical values are the boundaries of the rejection region determined by the significance level and the sampling distribution of the test statistic under the null hypothesis
• For a two-tailed test with significance level $\alpha$, the critical values are the $\frac{\alpha}{2}$ and $1-\frac{\alpha}{2}$ quantiles of the sampling distribution
• For a one-tailed test with significance level $\alpha$, the critical value is the $\alpha$ or $1-\alpha$ quantile of the sampling distribution, depending on the direction of the alternative hypothesis

P-values and Decision Rules

• P-value is the probability of observing a test statistic as extreme as the one calculated, assuming the null hypothesis is true
• P-values provide a measure of the strength of evidence against the null hypothesis
  • Smaller p-values indicate stronger evidence against the null hypothesis
• Decision rules based on p-values:
  • If the p-value is less than the significance level ($\alpha$), reject the null hypothesis
  • If the p-value is greater than or equal to the significance level ($\alpha$), fail to reject the null hypothesis
• P-values can be interpreted as the level of significance at which the null hypothesis would be rejected
• Reporting p-values along with the test results provides more information than simply stating whether the null hypothesis was rejected or not

One-Sample Z-Test

• Used when the population standard deviation is known and the sample size is large (n > 30) or the population is normally distributed
• Test statistic: $Z = \frac{\bar{x} - \mu_0}{\sigma / \sqrt{n}}$
  • $\bar{x}$ is the sample mean
  • $\mu_0$ is the hypothesized population mean under the null hypothesis
  • $\sigma$ is the known population standard deviation
  • $n$ is the sample size
• The test statistic follows a standard normal distribution under the null hypothesis
• Example: Testing whether the average weight of a product is equal to 500 grams, given a sample of 50 items with a sample mean of 495 grams and a known population standard deviation of 20 grams

One-Sample T-Test

• Used when the population standard deviation is unknown and the sample size is small (n ≤ 30) or when the population is normally distributed
• Test statistic: $T = \frac{\bar{x} - \mu_0}{s / \sqrt{n}}$
  • $\bar{x}$ is the sample mean
  • $\mu_0$ is the hypothesized population mean under the null hypothesis
  • $s$ is the sample standard deviation
  • $n$ is the sample size
• The test statistic follows a t-distribution with $n-1$ degrees of freedom under the null hypothesis
• Example: Testing whether the average score on a test is equal to 75, given a sample of 20 students with a sample mean of 78 and a sample standard deviation of 8

Practical Applications and Examples

• Quality control: Testing whether the mean weight of a product meets the specified requirements
  • Example: A company claims that the average weight of their cereal boxes is 500 grams. A random sample of 30 boxes has a mean weight of 495 grams with a standard deviation of 10 grams. Test the company's claim at a 5% significance level.
• Medical research: Comparing the effectiveness of a new drug to a placebo
  • Example: A new blood pressure medication is tested on a sample of 100 patients. The mean reduction in systolic blood pressure is 12 mmHg with a standard deviation of 5 mmHg. Test whether the medication significantly reduces blood pressure at a 1% significance level, given that the average reduction for a placebo is 8 mmHg.
• Psychology: Investigating whether a specific therapy leads to improved outcomes
  • Example: A therapist claims that a new therapy technique reduces anxiety levels. A sample of 25 patients who underwent the therapy has a mean anxiety score of 42 with a standard deviation of 6. Test the therapist's claim at a 10% significance level, given that the average anxiety score for the general population is 45.
• Education: Assessing whether a new teaching method results in higher test scores
  • Example: A school district implements a new math curriculum and wants to know if it improves student performance. A random sample of 50 students taught with the new curriculum has a mean score of 85 on a standardized test with a standard deviation of 8. Test whether the new curriculum significantly increases test scores at a 5% significance level, given that the average score for the previous curriculum was 82.