A critical value is a point on the scale of the test statistic that is compared to the test statistic to determine whether to reject the null hypothesis. It serves as a threshold that defines the boundaries of the rejection region, which helps in assessing whether the observed data falls significantly outside what would be expected under the null hypothesis.