A residual vector is the difference between the observed values and the values predicted by a mathematical model or approximation. This concept is crucial in numerical methods as it helps to assess the accuracy of the solution, guiding adjustments to improve model performance. In essence, the residual vector indicates how well a given model fits the data, serving as a feedback mechanism for refinement in iterative processes.