Residuals refer to the differences between the observed values and the predicted values in a statistical model. They represent the portion of the observed data that is not explained by the model, providing insights into the model's accuracy and the presence of unaccounted factors.