12.5 Outliers
3 min read•june 27, 2024
Outliers can significantly impact statistical analyses, potentially skewing results and leading to incorrect conclusions. Identifying and handling these data points is crucial for accurate interpretation of your data.
There are several methods to detect outliers, including the standard deviation rule and examining residuals. Removing outliers can dramatically change regression lines and correlation coefficients, highlighting the importance of careful consideration in data analysis.
Outliers
Outliers using standard deviations rule
Top images from around the web for Outliers using standard deviations rule
Normal distribution - Wikiversity View original
Is this image relevant?
Outlier - Wikipedia View original
Is this image relevant?
Standard score - wikidoc View original
Is this image relevant?
Normal distribution - Wikiversity View original
Is this image relevant?
Outlier - Wikipedia View original
Is this image relevant?
1 of 3
Top images from around the web for Outliers using standard deviations rule
Normal distribution - Wikiversity View original
Is this image relevant?
Outlier - Wikipedia View original
Is this image relevant?
Standard score - wikidoc View original
Is this image relevant?
Normal distribution - Wikiversity View original
Is this image relevant?
Outlier - Wikipedia View original
Is this image relevant?
1 of 3
- Data points significantly different from the rest of the data can substantially impact statistical analyses and should be carefully examined
- Common method for identifying potential outliers by calculating the mean and standard deviation of the dataset
- Any data point falling more than two standard deviations away from the mean is considered a ( greater than 2 or less than -2)
- calculated as
- calculated as
- Data points outside these boundaries should be further investigated to determine if they are true outliers (measurement errors) or merely unusual but valid observations (rare events)
Effects of outlier removal
- Outliers can significantly impact the (best fits the data points, minimizing sum of squared residuals) and (measure of linear relationship between two variables, ranging from -1 to 1)
- Removing an can change the and of the regression line
- Outlier far from the rest of the data points can "pull" the regression line towards itself
- Removing the outlier can result in a regression line better representing the majority of the data
- Correlation coefficient can be affected by the presence of outliers
- Outliers can artificially increase (positive outlier in a positive relationship) or decrease (negative outlier in a positive relationship) the correlation coefficient
- Removing an outlier can lead to a correlation coefficient more accurately reflecting the relationship between the variables for the majority of the data
Standard deviation of residuals
- Residuals are differences between observed values and predicted values from a regression line, calculated as
- can be used to identify potential outliers
- Calculate predicted values for each data point using the regression equation
- Compute residuals by subtracting predicted values from observed values
- Calculate standard deviation of the residuals
- Any data point with a residual more than two standard deviations away from zero is considered a potential outlier
- Lower boundary calculated as
- Upper boundary calculated as
- This method helps identify outliers based on their deviation from the regression line, rather than their deviation from the mean of the dataset
Additional outlier detection methods
- method: Identifies outliers based on the spread of the middle 50% of the data
- Outliers are typically defined as data points below Q1 - 1.5 * IQR or above Q3 + 1.5 * IQR
- This method is often visualized using a , which displays the median, quartiles, and potential outliers
- : Measures the influence of a data point on the regression line based on its distance from the mean of the predictor variable
- : Data points that have a disproportionate effect on the regression results
- is a measure used to identify influential points by quantifying the change in regression coefficients when an observation is excluded
Key Terms to Review (17)
Boxplot: A boxplot, also known as a box-and-whisker plot, is a standardized way of displaying the distribution of data based on a five-number summary: the minimum, first quartile, median, third quartile, and maximum. It provides a visual representation of the spread and symmetry of a dataset, making it useful for identifying outliers and comparing distributions.
Cook's Distance: Cook's distance is a measure used in regression analysis to identify influential observations, or outliers, that have a significant impact on the regression model. It quantifies the change in the regression coefficients that would result from the deletion of a particular observation.
Correlation Coefficient: The correlation coefficient is a statistical measure that quantifies the strength and direction of the linear relationship between two variables. It is a value that ranges from -1 to 1, with -1 indicating a perfect negative linear relationship, 0 indicating no linear relationship, and 1 indicating a perfect positive linear relationship.
Influential Points: Influential points, in the context of outliers, refer to data points that have a significant impact on the analysis or model being used. These points can exert a disproportionate influence on the results, potentially skewing the interpretation or conclusions drawn from the data.
Intercept: The intercept is a parameter in a linear regression model that represents the value of the dependent variable when the independent variable is zero. It is the point where the regression line intersects the y-axis, providing information about the starting point or baseline value of the relationship between the variables.
Interquartile Range (IQR): The interquartile range (IQR) is a measure of the spread or dispersion of a dataset. It represents the range of the middle 50% of the data, providing information about the variability within a distribution.
Leverage: Leverage refers to the influence or power that an observation, particularly an outlier, has on the fit of a statistical model. It is a measure of how far an independent variable deviates from its mean and can significantly affect the slope of the regression line, potentially skewing results and leading to incorrect conclusions.
Lower Boundary: The lower boundary is the minimum value or threshold that defines the lower end of a range or set of data points. It is an important concept in the context of identifying outliers, as it helps determine which data points fall outside the normal distribution and should be considered exceptional observations.
Outlier: An outlier is an observation or data point that lies an abnormal distance from other values in a data set. It is a data point that stands out from the rest of the data, often deviating significantly from the overall pattern or distribution of the data.
Potential Outlier: A potential outlier is an observation in a dataset that appears to deviate significantly from the overall pattern or distribution of the data. These observations may have a substantial impact on statistical analyses and can potentially skew the interpretation of results if not properly identified and addressed.
Regression Line: The regression line is a best-fit line that represents the average or predicted relationship between two variables in a scatter plot. It is used to model and analyze the linear association between the independent and dependent variables.
Residual: A residual is the difference between an observed value and the corresponding predicted value in a statistical model. It represents the portion of the observed value that is not explained by the model's predictions, providing insight into the model's fit and potential areas for improvement.
Slope: Slope is a measure of the steepness or incline of a line or surface. It represents the rate of change between two variables, typically the dependent and independent variables in a linear relationship.
Standard Deviation of Residuals: The standard deviation of residuals, also known as the root mean square error (RMSE), is a measure of the spread or dispersion of the differences between the observed values and the predicted values in a regression model. It quantifies the average magnitude of the errors or residuals, providing an indication of the overall fit of the model.
Standard Deviations Rule: The standard deviations rule, also known as the 68-95-99.7 rule, is a statistical principle that describes the distribution of data in a normal distribution. It states that a certain percentage of the data will fall within a specified number of standard deviations from the mean, providing a way to understand the spread and variability of the data.
Upper Boundary: The upper boundary is a statistical concept that represents the highest possible value within a specified range or distribution. It is a crucial element in the analysis of outliers, which are data points that lie outside the expected range of a dataset.
Z-Score: A z-score, also known as a standard score, is a statistical measure that expresses how many standard deviations a data point is from the mean of a dataset. It is a fundamental concept in statistics that is used to standardize and compare data across different distributions.