Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Outliers and Influential Points01:08

Outliers and Influential Points

5.0K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
5.0K
What Are Outliers?01:12

What Are Outliers?

4.2K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
4.2K
Quantifying and Rejecting Outliers: The Grubbs Test01:02

Quantifying and Rejecting Outliers: The Grubbs Test

4.0K
Sometimes, a data set can have a recorded numerical observation that greatly  deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier.  To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
4.0K
Trimmed Mean01:10

Trimmed Mean

2.2K
While measuring the mean of a data set, care needs to be taken when associating the mean to its central tendency. The same goes for the arithmetic mean, the geometric mean, or the harmonic mean. This is because the presence of a single outlier data value can significantly affect the mean. That is, the mean is sensitive to fluctuations in the data set.
Although certain measures of central tendency are not sensitive to outliers, there are alternative versions of the mean that get around the...
2.2K
Residuals and Least-Squares Property01:11

Residuals and Least-Squares Property

7.1K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.1K
Detection of Gross Error: The Q Test01:00

Detection of Gross Error: The Q Test

6.8K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.8K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Surface and in vitro corrosion properties of spark plasma sintered Ti-Zr-Nb-Ta-Ag high entropy alloy for dental implant applications.

Scientific reports·2025
Same author

Multifunctional poly (lactic acid)/vanillin coatings on drug loaded titanium nanotube arrays for improved biocompatibility, corrosion resistance, and antibacterial characteristics.

Scientific reports·2025
Same author

Multifunctional Polymeric Bioactive Coatings on Ti Implants through the Drug Delivery Approach: <i>In Vitro</i> Corrosion Resistance, Biocompatibility, and Antibacterial Characteristics.

ACS applied bio materials·2025
Same author

Sensitivity of broiler performance, organ weights and plasma constituents to amino acid supplementation and reused litter exposure using ideal protein-formulated rations.

Animal : an international journal of animal bioscience·2023
Same author

Ti-30Nb-3Ag alloy with improved corrosion resistance and antibacterial properties for orthopedic and dental applications produced by mechanical alloying.

Journal of the mechanical behavior of biomedical materials·2023
Same author

Influence of surface treatment on PEDOT coatings: surface and electrochemical corrosion aspects of newly developed Ti alloy.

RSC advances·2022

Related Experiment Video

Updated: Apr 25, 2026

A Method of Trigonometric Modelling of Seasonal Variation Demonstrated with Multiple Sclerosis Relapse Data
10:46

A Method of Trigonometric Modelling of Seasonal Variation Demonstrated with Multiple Sclerosis Relapse Data

Published on: December 9, 2015

10.3K

Outlier detection method in linear regression based on sum of arithmetic progression.

K K L B Adikaram1, M A Hussein2, M Effenberger3

  • 1Group Bio-Process Analysis Technology, Technische Universität München, Weihenstephaner Steig 20, 85354 Freising, Germany ; Institut für Landtechnik und Tierhaltung, Vöttinger Straße 36, 85354 Freising, Germany ; Computer Unit, Faculty of Agriculture, University of Ruhuna, Mapalana, 81100 Kamburupitiya, Sri Lanka.

Thescientificworldjournal
|August 15, 2014
PubMed
Summary

This study presents a novel nonparametric method for outlier detection in linear series, effectively identifying significant and nonsignificant outliers without data imputation. The method accurately detects outliers even in datasets with up to 50% erroneous values.

More Related Videos

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns
13:44

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns

Published on: August 30, 2013

42.6K
Semi-Automated Analysis of Peak Amplitude and Latency for Auditory Brainstem Response Waveforms Using R
06:01

Semi-Automated Analysis of Peak Amplitude and Latency for Auditory Brainstem Response Waveforms Using R

Published on: December 9, 2022

2.8K

Related Experiment Videos

Last Updated: Apr 25, 2026

A Method of Trigonometric Modelling of Seasonal Variation Demonstrated with Multiple Sclerosis Relapse Data
10:46

A Method of Trigonometric Modelling of Seasonal Variation Demonstrated with Multiple Sclerosis Relapse Data

Published on: December 9, 2015

10.3K
Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns
13:44

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns

Published on: August 30, 2013

42.6K
Semi-Automated Analysis of Peak Amplitude and Latency for Auditory Brainstem Response Waveforms Using R
06:01

Semi-Automated Analysis of Peak Amplitude and Latency for Auditory Brainstem Response Waveforms Using R

Published on: December 9, 2022

2.8K

Area of Science:

  • Data Science
  • Statistical Modeling
  • Time Series Analysis

Background:

  • Outlier detection is crucial for data integrity in various scientific fields.
  • Existing methods often require data imputation for missing or removed values, which can introduce bias.
  • Linear series, particularly arithmetic progressions, offer a unique structure for developing robust outlier detection techniques.

Purpose of the Study:

  • To introduce a new nonparametric outlier detection method for linear series.
  • To develop a method that does not require missing or removed data imputation.
  • To differentiate between significant and nonsignificant outliers.

Main Methods:

  • The method utilizes the ratio (R) of the sum of minimum and maximum elements to the sum of all elements in a series.
  • An arithmetic progression (without outliers) has a specific ratio (2/n), deviations from which indicate outliers.
  • Two techniques are proposed for handling missing or removed data: recalculating terms or transforming data to a constant value.

Main Results:

  • The proposed method successfully identifies outliers in linear series without requiring data imputation.
  • It demonstrated high accuracy in detecting outliers (deviating by ±1.0e-2 to ±1.0e+2) in datasets with up to 50% outliers.
  • The method proved effective for datasets ranging from 6 to 1000 elements.

Conclusions:

  • A novel, imputation-free nonparametric method for outlier detection in linear series has been developed.
  • The method is robust and effective, even with a high percentage of outliers and missing data.
  • This approach offers a valuable tool for data preprocessing and analysis in scientific research.