Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

What Are Outliers?01:12

What Are Outliers?

3.9K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
3.9K
Outliers and Influential Points01:08

Outliers and Influential Points

4.1K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.1K
Quantifying and Rejecting Outliers: The Grubbs Test01:02

Quantifying and Rejecting Outliers: The Grubbs Test

1.6K
Sometimes, a data set can have a recorded numerical observation that greatly  deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier.  To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.6K
Modified Boxplots00:57

Modified Boxplots

9.8K
A standard box and whisker plot informs us about the spread of the data in a given sample. One can identify the minimum value, maximum value, first quartile value, second quartile or median value, and third quartile.
However, the box plot does not tell the reader about outliers - values that lie far from the center of the data. We can modify the standard box and whisker plot to identify the outliers and visualize the actual spread of the data in a sample.
Initially, we calculate the adjusted...
9.8K
Detection of Gross Error: The Q Test01:00

Detection of Gross Error: The Q Test

6.2K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.2K
Unusual Results01:16

Unusual Results

3.2K
Unusual results are those that have a very low chance of occurring. Unusual results can be identified using probabilities and the range rule of thumb. In problems involving probability, unusual results can be observed in 2 instances – an unusually high number of successes or an unusually low number of successes.
According to the range rule of thumb, any value above or below two standard deviations, 2σ  from the mean, μ  is considered unusual.
Maximum unusual value =...
3.2K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Ensuring Fairness in Detecting Mild Cognitive Impairment with MRI.

AMIA ... Annual Symposium proceedings. AMIA Symposium·2025
Same author

Enhancing clinical outcome predictions through effective sample size evaluation in graph-based digital twin modeling.

BioData mining·2025
Same author

Perceptual and technical barriers in sharing and formatting metadata accompanying omics studies.

Cell genomics·2025
Same author

Erratum: A latent transfer learning method for estimating hospital-specific post-acute healthcare demands following SARS-CoV-2 infection.

Patterns (New York, N.Y.)·2025
Same author

AI as an accelerator for defining new problems that transcends boundaries.

BioData mining·2025
Same author

Preoperative anemia is an unsuspecting driver of machine learning prediction of adverse outcomes after lumbar spinal fusion.

The spine journal : official journal of the North American Spine Society·2025

Related Experiment Video

Updated: Jul 17, 2025

Author Spotlight: Advancing the Study of Brain-Heart Interplay with a Comprehensive EEGLAB Plugin for Multimodal Signal Analysis
08:22

Author Spotlight: Advancing the Study of Brain-Heart Interplay with a Comprehensive EEGLAB Plugin for Multimodal Signal Analysis

Published on: April 26, 2024

1.9K

STAR_outliers: a python package that separates univariate outliers from non-normal distributions.

John T Gregg1, Jason H Moore2

  • 1Department of Biostatistics, Epidemiology and Informatics, University of Pennsylvania, Philadelphia, PA, USA.

Biodata Mining
|September 4, 2023
PubMed
Summary
This summary is machine-generated.

STAR_outliers effectively removes univariate outliers from diverse data distributions, outperforming existing methods in precision and recall for simulated and real-world data. This new algorithm accurately models various distribution shapes, improving outlier detection accuracy.

Keywords:
OutliersSoftwareStatistics

More Related Videos

Detection of Rare Genomic Variants from Pooled Sequencing Using SPLINTER
14:06

Detection of Rare Genomic Variants from Pooled Sequencing Using SPLINTER

Published on: June 23, 2012

15.3K
Surface Mapping of Earth-like Exoplanets using Single Point Light Curves
06:48

Surface Mapping of Earth-like Exoplanets using Single Point Light Curves

Published on: May 10, 2020

3.6K

Related Experiment Videos

Last Updated: Jul 17, 2025

Author Spotlight: Advancing the Study of Brain-Heart Interplay with a Comprehensive EEGLAB Plugin for Multimodal Signal Analysis
08:22

Author Spotlight: Advancing the Study of Brain-Heart Interplay with a Comprehensive EEGLAB Plugin for Multimodal Signal Analysis

Published on: April 26, 2024

1.9K
Detection of Rare Genomic Variants from Pooled Sequencing Using SPLINTER
14:06

Detection of Rare Genomic Variants from Pooled Sequencing Using SPLINTER

Published on: June 23, 2012

15.3K
Surface Mapping of Earth-like Exoplanets using Single Point Light Curves
06:48

Surface Mapping of Earth-like Exoplanets using Single Point Light Curves

Published on: May 10, 2020

3.6K

Area of Science:

  • Statistics
  • Data Science
  • Machine Learning

Background:

  • Univariate outlier detection is challenging for arbitrarily shaped distributions.
  • Existing methods struggle with skew, kurtosis, bimodality, and monotonicity.
  • Multivariate algorithms are often unsuitable for univariate outlier removal.

Purpose of the Study:

  • To develop a robust univariate outlier detection algorithm for diverse data distributions.
  • To address limitations of current methods in modeling complex distribution shapes.
  • To improve the accuracy and reliability of outlier removal.

Main Methods:

  • Implemented Skew and Tail-heaviness Adjusted Removal of Outliers (STAR_outliers) algorithm.
  • Combined established algorithms to model arbitrarily shaped univariate distributions.
  • Validated STAR_outliers against normality-assuming methods, Isolation Forest, and IQR-based algorithms.

Main Results:

  • STAR_outliers demonstrated superior recall and precision in removing simulated outliers.
  • The algorithm accurately modeled outlier bounds in real-world NHANES data.
  • STAR_outliers removed a more accurate percentage of values (0.7%) compared to other methods.

Conclusions:

  • STAR_outliers is a flexible and effective Python package for univariate outlier removal.
  • The algorithm outperforms common outlier detection methods across various distribution types.
  • STAR_outliers offers improved accuracy for real-world datasets.