在功能数据中使用调整的偏度检测异常值
Zhenghui Feng1, Xiaodan Hong2, Yingxing Li3
1School of Science, Harbin Institute of Technology, Shenzhen 518055, China.
Entropy (Basel, Switzerland)
|February 27, 2026
概括
本研究引入了一种新的方法,通过将曲线投射到低维特征空间中来检测功能数据中的异常. 该方法有效地识别了微妙的偏差,改善了数据完整性和在各种应用程序中发现异常.
科学领域:
- 统计 统计 统计 统计
- 信号处理 信号处理
- 数据分析 数据分析
背景情况:
- 异常检测对于数据完整性和可靠分析至关重要.
- 由于高维度和微妙的形状变形,检测功能数据中的异常值具有挑战性.
- 传统方法往往使曲线变得离散,失去重要的变化.
研究的目的:
- 开发一种用于功能数据中强大的异常值检测的新框架.
- 为了应对功能数据的无限维度所带来的挑战.
- 提高复杂数据集中异常识别的准确性和效率.
主要方法:
- 使用量身定制的权重方案,将功能数据投射到一个低维特征空间中.
- 在非高斯假设下使用马哈拉诺比斯距离来检测方向偏.
- 使用一个强大的启动重抽样方法与数据驱动的值确定.
主要成果:
- 拟议的框架在模拟中表现出卓越的性能.
- 对于各种异常值类型,实现了更高的真正阳性率和更低的虚假阳性率.
- 通过环境,轨迹和人口数据分析的实际应用来验证.
结论:
- 这种新型框架为功能数据异常值检测提供了一种多功能且有效的解决方案.
- 该方法增强了数据清理,并促进了异常事件的发现.
- 它的跨领域适用性凸显了它在各种科学领域的实际实用性.
相关概念视频
Quantifying and Rejecting Outliers: The Grubbs Test
4.3K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
4.3K
What Are Outliers?
5.4K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
5.4K
Outliers and Influential Points
6.5K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
6.5K
Detection of Gross Error: The Q Test
7.1K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
7.1K
Modified Boxplots
11.6K
A standard box and whisker plot informs us about the spread of the data in a given sample. One can identify the minimum value, maximum value, first quartile value, second quartile or median value, and third quartile.
However, the box plot does not tell the reader about outliers - values that lie far from the center of the data. We can modify the standard box and whisker plot to identify the outliers and visualize the actual spread of the data in a sample.
Initially, we calculate the adjusted...
However, the box plot does not tell the reader about outliers - values that lie far from the center of the data. We can modify the standard box and whisker plot to identify the outliers and visualize the actual spread of the data in a sample.
Initially, we calculate the adjusted...
11.6K
Goodness-of-Fit Test
9.3K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
9.3K


