一个新的混合模型,用于改进异常值检测,使用组合自编码器和变异自编码器.
Ahmed M Daoud1, Osama M Elkomy1, Walid I Khedr1
1Department of Information Technology, Faculty of Computers and Informatics, Zagazig University, Zagazig, Egypt.
Scientific reports
|December 8, 2025
概括
一种新的混合型号,AVE,结合了自动编码器 (AE) 和变异自动编码器 (VAE),在高维数据中实现了优越的异常值检测. AVE显著优于现有方法,为异常检测挑战提供了更可靠的解决方案.
科学领域:
- 机器学习 机器学习
- 数据科学数据科学数据科学
- 人工智能的人工智能
背景情况:
- 高维数据集对准确的异常值检测提出了重大挑战.
- 现有的方法如自动编码器 (AE) 和变量自动编码器 (VAE) 在稳定性和性能方面存在局限性.
研究的目的:
- 引入一种新的混合模型,AVE (自编码器-变量自编码器),用于增强异常值检测.
- 评估AVE模型在多样化,高维数据集上的性能.
主要方法:
- 开发了一个混合架构,将AE的重建能力与VAE的规范化潜伏空间集成在一起.
- 对来自不同领域的16个标准基准数据集进行了广泛的实验评估.
主要成果:
- 与独立的AE,VAE和其他算法相比,AVE模型表现出更高的性能.
- 实现了0.6925的平均精度和0.8902的ROC-AUC,明显超过现有方法.
- 在16个数据集中,在12个数据集中获得了最佳准确性,在5.5个数据集中获得了最佳ROC-AUC.
结论:
- AVE混合模型为异常值检测提供了更可靠,更精确的方法,特别是在复杂的高维数据中.
- AVE为现实世界的异常检测应用提供了强大而有效的解决方案.
相关概念视频
Variance
11.9K
The deviations show how spread out the data are about the mean. A positive deviation occurs when the data value exceeds the mean, whereas a negative deviation occurs when the data value is less than the mean. If the deviations are added, the sum is always zero. So one cannot simply add the deviations to get the data spread. By squaring the deviations, the numbers are made positive; thus, their sum will also be positive.
The standard deviation measures the spread in the same units as the data....
The standard deviation measures the spread in the same units as the data....
11.9K
Outliers and Influential Points
5.9K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
5.9K
What Are Outliers?
4.9K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
4.9K
Quantifying and Rejecting Outliers: The Grubbs Test
3.5K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
3.5K
Variability: Analysis
426
Measures of variability are statistical metrics that reveal the dispersion pattern within a dataset. They are pivotal in biostatistics, providing insights into the heterogeneity within health and biological data. Variability signifies the degree to which data points diverge from one another, helping researchers understand the potential range of values and associated uncertainty within the data.
The range is a simple measure of variability, indicating the difference between the highest and...
The range is a simple measure of variability, indicating the difference between the highest and...
426
Improving Translational Accuracy
14.0K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
14.0K

