Jove
Visualize
Contact Us

Related Concept Videos

What Are Outliers?01:12

What Are Outliers?

3.9K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
3.9K
Quantifying and Rejecting Outliers: The Grubbs Test01:02

Quantifying and Rejecting Outliers: The Grubbs Test

1.7K
Sometimes, a data set can have a recorded numerical observation that greatly  deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier.  To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.7K
Outliers and Influential Points01:08

Outliers and Influential Points

4.1K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.1K
Detection of Gross Error: The Q Test01:00

Detection of Gross Error: The Q Test

6.2K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.2K
Extraction: Partition and Distribution Coefficients01:14

Extraction: Partition and Distribution Coefficients

2.5K
The distribution law or Nernst's distribution law is the law that governs the distribution of a solute between two immiscible solvents. This law, also known as the partition law, states that if a solute is added to the mixture of two immiscible solvents at a constant temperature, the solute is distributed between the two solvents in such a way that the ratio of solute concentrations in the solvents remains constant at equilibrium.
For extracting a solute from an aqueous phase into an...
2.5K
Expected Frequencies in Goodness-of-Fit Tests01:19

Expected Frequencies in Goodness-of-Fit Tests

2.6K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n)  to the number of categories (k).
2.6K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Research on the Security of IPv6 Communication Based on Petri Net under IoT.

Sensors (Basel, Switzerland)·2023
Same author

Modeling Analysis of SM2 Construction Attacks in the Open Secure Sockets Layer Based on Petri Net.

Sensors (Basel, Switzerland)·2022
Same journal

Research on a Regional Availability Evaluation Model for Road-Area High-Entropy Energy Based on Synergy Factors.

Entropy (Basel, Switzerland)·2026
Same journal

Atmospheric Turbulence Channel Modeling and Performance Analysis of a CO-ZP-OFDM Coherent Optical Communication System for UAV Air-to-Ground Scenarios.

Entropy (Basel, Switzerland)·2026
Same journal

Information Geometry and Asymptotic Theory for SMML Estimators.

Entropy (Basel, Switzerland)·2026
Same journal

Correlation Entropy and Power-Law Kinetics.

Entropy (Basel, Switzerland)·2026
Same journal

Research on the Contagion of Systemic Financial Risk Under the Impact of Climate Risks-From the Perspective of Complex Networks and Machine Learning.

Entropy (Basel, Switzerland)·2026
Same journal

The Statistical-Mechanical Meaning of the Wave Function of Quantum Mechanics.

Entropy (Basel, Switzerland)·2026
See all related articles
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Jul 18, 2025

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

7.5K

An Ensemble Outlier Detection Method Based on Information Entropy-Weighted Subspaces for High-Dimensional Data.

Zihao Li1, Liumei Zhang1

  • 1School of Computing, Xi'an Shiyou University, Xi'an 710065, China.

Entropy (Basel, Switzerland)
|August 26, 2023
PubMed
Summary
This summary is machine-generated.

This study introduces the Ensemble Outlier Detection Method Based on Information Entropy-Weighted Subspaces for High-Dimensional Data (EOEH), an effective algorithm for identifying outliers in complex, high-dimensional datasets. EOEH significantly improves detection accuracy and runtime efficiency compared to existing methods.

Keywords:
ensemblehigh-dimensional datainformation entropyoutlier detectionsubspaces

More Related Videos

The Terroir Concept Interpreted through Grape Berry Metabolomics and Transcriptomics
13:02

The Terroir Concept Interpreted through Grape Berry Metabolomics and Transcriptomics

Published on: October 5, 2016

10.5K
ExCYT: A Graphical User Interface for Streamlining Analysis of High-Dimensional Cytometry Data
05:12

ExCYT: A Graphical User Interface for Streamlining Analysis of High-Dimensional Cytometry Data

Published on: January 16, 2019

11.5K

Related Experiment Videos

Last Updated: Jul 18, 2025

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

7.5K
The Terroir Concept Interpreted through Grape Berry Metabolomics and Transcriptomics
13:02

The Terroir Concept Interpreted through Grape Berry Metabolomics and Transcriptomics

Published on: October 5, 2016

10.5K
ExCYT: A Graphical User Interface for Streamlining Analysis of High-Dimensional Cytometry Data
05:12

ExCYT: A Graphical User Interface for Streamlining Analysis of High-Dimensional Cytometry Data

Published on: January 16, 2019

11.5K

Area of Science:

  • Data Mining
  • Machine Learning
  • High-Dimensional Data Analysis

Background:

  • Outlier detection is crucial in data mining and machine learning, but high-dimensional data presents challenges due to sparsity and the 'curse of dimensionality'.
  • Conventional methods often fail in high-dimensional spaces, masking outliers with noise effects.

Purpose of the Study:

  • To propose a novel outlier detection algorithm, EOEH, specifically designed for high-dimensional data.
  • To enhance outlier detection performance and runtime efficiency in industrial automation and machine learning contexts.

Main Methods:

  • EOEH employs random subsampling and detector aggregation for robustness.
  • Information entropy is used for dimension-space weighting to identify influential factors and create weighted subspaces.
  • A high-precision local outlier factor (HPLOF) detector is integrated to enhance outlier differentiation.

Main Results:

  • Experiments on simulated and UCI datasets validate EOEH's feasibility.
  • EOEH demonstrates superior detection performance, improving accuracy by an average of 6% compared to popular algorithms.
  • EOEH achieves a 20% faster runtime for high-dimensional data processing.

Conclusions:

  • EOEH effectively addresses the 'curse of dimensionality' in outlier detection.
  • The algorithm offers significant improvements in both accuracy and efficiency for high-dimensional datasets.
  • EOEH provides a robust and efficient solution for outlier detection in machine learning and data mining.