Join Our Discord

Learn Moreย ย ๐Ÿ‘‡

caret down
caret up

Join our Discord

1,000s of Fiveable Community students are already finding study help, meeting new friends, and sharing tons of opportunities among other students around the world! Don't miss out!ย  ๐ŸŽ‰

group of students
group of students

๐Ÿ“Šย ap stats

ย ย >ย ย 

โš–๏ธย Unit 6

ย ย โ€ขย ย โฑ๏ธ4 min read

6.7 Potential Errors When Performing Tests

Josh Argo

josh argo

โฑ๏ธ June 5, 2020


What is an Error?

No matter how well we design our test, perform our calculations and follow our correct procedures, we are still prone to error in our tests. This doesn't necessarily mean we did something wrong in our sampling or our calculations, but just that our calculations gave us an incorrect result. We always have that small random chance of achieving a rare sample that leads us to incorrect results and there are ways that we can minimize this effect.

Type 1 Error

A Type 1 error is when we reject our Ho, when in fact, we should have failed to reject. This is due to a low p-value that lead us to make a decision, but actually we drew an extremely rare sample from our population. The probability of making a Type 1 Error is the same as our significance level (or ๐žช).

A significance level of 0.05 is usually a good middle ground that minimizes this type of error, but also keeps us from making other errors in our study.

Type 2 Error

A Type 2 error is when we fail to reject our Ho, but we actually should have rejected our Ho. An easy way to remember this is that we "fail 2 reject in a Type 2 error". This is due to the fact that we did not get a low enough p-value to reject our Ho, but in reality, our Ho is not the truth and there should have been convincing evidence for Ha. Again, 0.05 is a good significance level that minimizes the probability of making this type of error, while also being sure that our calculations obtained are still statistically significant. The probability of making a Type 2 Error is ๐žซ. This is easy to remember because the probabilities of a Type 1/2 Error are alpha/beta respectively.


The complement of ๐žซ is known as the power of our test. The power is basically a way of saying how strong our test is because it is the probability of NOT making a Type 2 error. We can increase our power by increasing our sample size. Remember, the larger our sample, the closer our estimate is the population parameter, so the less likely we are to make a mistake.

Test Pointers

Common AP Test questions regarding types of errors and power typically ask the following questions:

Identify Error

The first thing AP is likely to ask is how to identify either a Type 1 or 2 error. This is basically writing out the definitions above in context of the given problem. Learn the definitions using the trick above and this part is easy.

Consequence of Error

Past AP Statistics test also like to ask about the consequence of an error. If we rejected a null hypothesis when we shouldn't have, what are the consequences (in context) of making such an error?

Increase Power

The last thing that AP likes to ask about regarding errors and power is how we can increase power. The answer is always to increase sample size.


image courtesy of:

In a recent study, a researcher was testing the claim that 85% of people are satisfied with their current personal reading goals and achievements. The researcher has reason to believe that this proportion is lower and that people are actually not happy with their personal reading plans and need a new library to borrow from. Therefore, the researcher tests the following hypotheses to see if opening a new public library would help people reach their personal reading goals:

Ho: p=0.85

Ha: p<0.85

a. Describe a Type 2 error in context of the problem. Also, list a consequence of making this type of error.

If the researcher makes a Type 2 error in this problem, he/she has failed to reject the Ho, when in fact it should be rejected. This means that the researcher concluded that we did not have evidence that the true population proportion was less than 0.85, when in fact, there is convincing evidence that it is less than 0.85. A consequence of this error is that people will likely remain largely unhappy with their reading achievement when a new library may help them reach their reading goals.

b. What can the researcher do to increase the power of this test?

The researcher can increase the power of this test and therefore decrease the probability of making a Type 2 error by increasing the sample size in the study.

๐ŸŽฅWatch: AP Stats - Inference: Errors and Powers of Test

A tent in the woods with a fire

Get your ap stats survival pack!

Download our ap stats survival pack and get access to every resource you need to get a 5.

ap stats study guides

โœŒ๏ธย  Unit 2: Exploring Two-Variable Data

โš–๏ธย  Unit 6: Inference for Categorical Data: Proportions

๐Ÿ˜ผย  Unit 7: Inference for Qualitative Data: Means

โœณ๏ธย  Unit 8: Inference for Categorical Data: Chi-Square

๐Ÿ“ˆย  Unit 9: Inference for Quantitative Data: Slopes

๐Ÿงย  Multiple Choice Questions (MCQs)

continue learning

Slide 1 of 13

Join Our Discord


Fiveable Community students are already meeting new friends, starting study groups, and sharing tons of opportunities for other high schoolers. Soon the Fiveable Community will be on a totally new platform where you can share, save, and organize your learning links and lead study groups among other students!๐ŸŽ‰

*apยฎ and advanced placementยฎ are registered trademarks of the college board, which was not involved in the production of, and does not endorse, this product.

ยฉ fiveable 2021 | all rights reserved.

2550 north lake drive
suite 2
milwaukee, wi 53211