Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Quantifying and Rejecting Outliers: The Grubbs Test01:02

Quantifying and Rejecting Outliers: The Grubbs Test

Sometimes, a data set can have a recorded numerical observation that greatly  deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier.  To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This number is...
Detection of Gross Error: The Q Test01:00

Detection of Gross Error: The Q Test

When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
Outliers and Influential Points01:08

Outliers and Influential Points

An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the vertical...
What Are Outliers?01:12

What Are Outliers?

Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
Analysis of Population Pharmacokinetic Data01:12

Analysis of Population Pharmacokinetic Data

Analysis of population pharmacokinetic data involves studying the behavior of drugs within diverse populations to understand their pharmacokinetic parameters. Traditional pharmacokinetic methods typically involve collecting samples from a few individuals and estimating these parameters. While these methods are commonly used, they have limitations in capturing the variability in drug response among individuals or heterogeneous populations. Population pharmacokinetics is employed to address these...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Loss of Pten synergizes with c-Met to promote hepatocellular carcinoma development via mTORC2 pathway.

Experimental & molecular medicine·2018
Same author

Content-based image retrieval for Lung Nodule Classification Using Texture Features and Learned Distance Metric.

Journal of medical systems·2017
Same author

[Association between the ALK Gene Status and the Efficacy of First-line 
Pemetrexed Chemotherapy in Patients with Advanced Lung Adenocarcinoma].

Zhongguo fei ai za zhi = Chinese journal of lung cancer·2017
Same author

3D hole-transporting materials based on coplanar quinolizino acridine for highly efficient perovskite solar cells.

Chemical science·2017
Same author

ITGBL1 Predicts a Poor Prognosis and Correlates EMT Phenotype in Gastric Cancer.

Journal of Cancer·2017
Same author

The collective influence of 1, 25-dihydroxyvitamin D<sub>3</sub> with physiological fluid shear stress on osteoblasts.

Steroids·2017

Related Experiment Video

Updated: May 29, 2026

Competitive Genomic Screens of Barcoded Yeast Libraries
11:59

Competitive Genomic Screens of Barcoded Yeast Libraries

Published on: August 11, 2011

[Multi-population elitists shared genetic algorithm for outlier detection of spectroscopy analysis].

Hui Cao1, Yan Zhou

  • 1School of Electrical Engineering, Xi'an Jiaotong University, Xi'an 710049, China. huicao@mail.xjtu.edu.cn

Guang Pu Xue Yu Guang Pu Fen Xi = Guang Pu
|September 28, 2011
PubMed
Summary

This study introduces a novel outlier detection method using a genetic algorithm for spectral analysis. The new approach significantly improves prediction accuracy for moisture, fat, and protein content in datasets.

More Related Videos

Detection of Rare Genomic Variants from Pooled Sequencing Using SPLINTER
14:06

Detection of Rare Genomic Variants from Pooled Sequencing Using SPLINTER

Published on: June 23, 2012

Related Experiment Videos

Last Updated: May 29, 2026

Competitive Genomic Screens of Barcoded Yeast Libraries
11:59

Competitive Genomic Screens of Barcoded Yeast Libraries

Published on: August 11, 2011

Detection of Rare Genomic Variants from Pooled Sequencing Using SPLINTER
14:06

Detection of Rare Genomic Variants from Pooled Sequencing Using SPLINTER

Published on: June 23, 2012

Area of Science:

  • Spectral analysis
  • Chemometrics
  • Machine learning

Context:

  • Outlier detection is crucial for accurate spectral data analysis.
  • Near-infrared (NIR) spectroscopy is widely used for compositional analysis.
  • Existing outlier detection methods may lack efficiency and robustness.

Purpose:

  • To propose a novel outlier detection method for spectral analysis using a multi-population elitist shared genetic algorithm.
  • To evaluate the method's effectiveness in improving prediction models for moisture, fat, and protein content.
  • To compare the proposed method against traditional outlier detection techniques.

Summary:

  • A new outlier detection technique based on a multi-population elitist shared genetic algorithm was developed.
  • The method was applied to NIR spectral data to remove outliers before building partial least squares (PLS) prediction models.
  • The proposed method demonstrated substantial reductions in prediction residual error sum of squares (PRESS) for moisture, fat, and protein compared to other methods.

Impact:

  • The proposed spectral outlier detection method enhances the accuracy and robustness of prediction models.
  • This approach is applicable across different species for spectral data analysis.
  • Improved outlier detection leads to more reliable compositional analysis using spectral data.