Related Experiment Video
Updated: Aug 15, 2026
13:44
Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns
Published on: August 30, 2013
Detection of outliers in reference distributions: performance of Horn's algorithm
Helge Erik Solberg1, Ari Lahti
1Department of Medical Biochemistry, Rikshospitalet-Radiumhospitalet HF, Oslo, Norway.
Clinical Chemistry
|October 15, 2005
Summary
Horn's outlier detection algorithm shows improved performance but still struggles with specificity and sensitivity in medical reference data. Reliable statistical outlier identification remains a significant challenge for laboratory data analysis.
Area of Science:
- Medical Laboratory Science
- Biostatistics
- Statistical Computing
Background:
- Outliers in medical laboratory reference data can skew results and require elimination.
- Horn's algorithm offers a statistical method for outlier detection in reference intervals.
- The algorithm involves data transformation and establishing detection limits (Tukey fences).
Purpose of the Study:
- To evaluate the specificity and sensitivity of Horn's outlier detection algorithm.
- To assess algorithm performance across various probability distributions and outlier scenarios.
- To compare different data transformation methods within the algorithm.
Main Methods:
- Monte Carlo computer simulations were employed.
- 13 probability distributions with varying skewness were simulated.
- Outliers were introduced by replacing 3% of observations.
Main Results:
- Horn's algorithm demonstrated poor specificity for many distributions, linked to non-Gaussian kurtosis.
- Sensitivity varied significantly based on the underlying distribution and outlier location.
- The Box and Cox, Manly exponential, and John and Draper modulus functions were tested for data transformation.
Conclusions:
- Horn's algorithm represents an advancement over older outlier detection methods.
- Accurate statistical identification of outliers in reference data continues to be a challenge.
- Further research is needed to improve outlier detection reliability in medical laboratory settings.
Related Concept Videos
01:02Quantifying and Rejecting Outliers: The Grubbs Test
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This number is...
01:08Outliers and Influential Points
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the vertical...
01:00Detection of Gross Error: The Q Test
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
01:12What Are Outliers?
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
01:16Unusual Results
Unusual results are those that have a very low chance of occurring. Unusual results can be identified using probabilities and the range rule of thumb. In problems involving probability, unusual results can be observed in 2 instances – an unusually high number of successes or an unusually low number of successes.
According to the range rule of thumb, any value above or below two standard deviations, 2σ from the mean, μ is considered unusual.
Maximum unusual value = μ + 2σ
Minimum unusual value...
According to the range rule of thumb, any value above or below two standard deviations, 2σ from the mean, μ is considered unusual.
Maximum unusual value = μ + 2σ
Minimum unusual value...
01:19Expected Frequencies in Goodness-of-Fit Tests
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).