通过原型分析,通过图像和信号处理应用来检测聚类功能数据的异常值
Aleix Alcacer1, Irene Epifanio1,2
1Department of Mathematics, Universitat Jaume I, Castelló, Spain.
PloS one
|November 25, 2024
概括
这项研究引入了一个新的曲线异常检测方法,有效用于集群的功能数据. 这种新的方法扩展了AA + kNN技术,在各种应用中表现优于现有的方法.
科学领域:
- 数据科学数据科学数据科学
- 机器学习 机器学习
- 统计 统计 统计 统计
背景情况:
- 异常检测对于识别数据中的不寻常模式至关重要.
- 现有的方法往往难以在聚类的功能数据集中检测异常值.
- 多变量分析技术需要适应功能数据环境.
研究的目的:
- 开发一种用于曲线异常检测的创新方法.
- 扩展AA + kNN技术的应用到功能数据.
- 在聚类功能数据集中识别异常值.
主要方法:
- 将AA + kNN技术扩展到功能数据.
- 对12种最先进的异常检测方法进行比较分析.
- 通过单个和多个功能集群的模拟数据进行验证.
主要成果:
- 拟议的方法在功能数据异常检测方面表现出卓越的性能.
- 在模拟的集群数据集中验证了有效性.
- 在计算机视觉和信号处理任务中成功应用.
结论:
- 这种新的方法提供了一种有效的解决方案,用于在聚类功能数据中检测异常.
- 扩展的AA + kNN方法提供了改进的异常标识能力.
- 这项研究有助于在功能数据分析和异常检测方面取得进一步进展.
相关概念视频
What Are Outliers?
3.6K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
3.6K
Quantifying and Rejecting Outliers: The Grubbs Test
1.5K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.5K
Outliers and Influential Points
4.0K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.0K
Detection of Gross Error: The Q Test
5.6K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
5.6K
Modified Boxplots
9.1K
A standard box and whisker plot informs us about the spread of the data in a given sample. One can identify the minimum value, maximum value, first quartile value, second quartile or median value, and third quartile.
However, the box plot does not tell the reader about outliers - values that lie far from the center of the data. We can modify the standard box and whisker plot to identify the outliers and visualize the actual spread of the data in a sample.
Initially, we calculate the adjusted...
However, the box plot does not tell the reader about outliers - values that lie far from the center of the data. We can modify the standard box and whisker plot to identify the outliers and visualize the actual spread of the data in a sample.
Initially, we calculate the adjusted...
9.1K
Significance Testing: Overview
3.3K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
3.3K


