Related Experiment Video
Updated: Jun 6, 2025

13:44
Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns
Published on: August 30, 2013
42.8K
Outlier detection of clustered functional data with image and signal processing applications by archetype analysis
Aleix Alcacer1, Irene Epifanio1,2
1Department of Mathematics, Universitat Jaume I, Castelló, Spain.
Plos One
|November 25, 2024
Summary
This study introduces a new anomaly detection method for curves, effective for clustered functional data. The novel approach extends the AA + kNN technique, outperforming existing methods in diverse applications.
Area of Science:
- Data Science
- Machine Learning
- Statistics
Background:
- Anomaly detection is crucial for identifying unusual patterns in data.
- Existing methods often struggle with detecting outliers in clustered functional datasets.
- Multivariate analysis techniques need adaptation for functional data contexts.
Purpose of the Study:
- To develop an innovative methodology for anomaly detection of curves.
- To extend the AA + kNN technique for application to functional data.
- To identify outliers within clustered functional data sets.
Main Methods:
- Extension of the AA + kNN technique to functional data.
- Comparative analysis against twelve state-of-the-art anomaly detection methods.
- Validation through simulated data with single and multiple functional clusters.
Main Results:
- The proposed method demonstrates superior performance in anomaly detection for functional data.
- Effectiveness validated across simulated clustered datasets.
- Successful application in computer vision and signal processing tasks.
Conclusions:
- The novel methodology provides an effective solution for anomaly detection in clustered functional data.
- The extended AA + kNN approach offers improved outlier identification capabilities.
- The research facilitates further advancements in functional data analysis and anomaly detection.
Related Concept Videos
What Are Outliers?
3.6K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
3.6K
Quantifying and Rejecting Outliers: The Grubbs Test
1.5K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.5K
Outliers and Influential Points
4.0K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.0K
Detection of Gross Error: The Q Test
5.6K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
5.6K
Modified Boxplots
9.1K
A standard box and whisker plot informs us about the spread of the data in a given sample. One can identify the minimum value, maximum value, first quartile value, second quartile or median value, and third quartile.
However, the box plot does not tell the reader about outliers - values that lie far from the center of the data. We can modify the standard box and whisker plot to identify the outliers and visualize the actual spread of the data in a sample.
Initially, we calculate the adjusted...
However, the box plot does not tell the reader about outliers - values that lie far from the center of the data. We can modify the standard box and whisker plot to identify the outliers and visualize the actual spread of the data in a sample.
Initially, we calculate the adjusted...
9.1K
Significance Testing: Overview
3.3K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
3.3K

