通过得分导向网络增强无监督异常检测
概括
这项研究引入了一个新的评分网络,通过增加正常和异常数据之间的分数差异来改善无监督异常检测. 这种方法增强了表示学习,并在各种数据集上实现了最先进的性能.
科学领域:
- 机器学习 机器学习
- 数据科学数据科学数据科学
- 人工智能的人工智能
背景情况:
- 异常检测在医疗保健和金融领域至关重要,但有限的标签需要无监督的方法.
- 现有的无监督方法很难区分混合的正常/异常数据,并有效地最大化得分差异.
- 代表性学习是关键,但定义指标以在假设空间中分离数据仍然具有挑战性.
研究的目的:
- 提出一个新的得分网络,以得分为导向的规范化,以加强异常检测.
- 改进学习的信息表示,特别是在过渡领域的数据.
- 提供一个插件组件,增强现有的无监督表示学习模型.
主要方法:
- 开发了一个得分网络,以得分为导向的规范化来扩大异常得分差异.
- 将评分网络集成到一个自动编码器和四个最先进的无监督表示学习模型 (SG模型) 中.
- 评估了拟议方法在合成和现实世界数据集上的有效性和可转移性.
主要成果:
- 建议的以分数为导向的策略使得逐渐学习更具信息性的表示成为可能.
- SG-Models在各种数据集中展示了最先进的性能.
- 评分网络有效地作为各种深度无监督异常检测模型的插件组件.
结论:
- 新的评分网络和以评分为导向的规范化显著提高了无监督异常检测能力.
- SG模型为识别复杂系统中的异常提供了多功能和有效的解决方案.
- 该方法显示出强大的有效性和可转移性,优于现有方法.
相关概念视频
What Are Outliers?
3.9K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
3.9K
Unusual Results
3.2K
Unusual results are those that have a very low chance of occurring. Unusual results can be identified using probabilities and the range rule of thumb. In problems involving probability, unusual results can be observed in 2 instances – an unusually high number of successes or an unusually low number of successes.
According to the range rule of thumb, any value above or below two standard deviations, 2σ from the mean, μ is considered unusual.
Maximum unusual value =...
According to the range rule of thumb, any value above or below two standard deviations, 2σ from the mean, μ is considered unusual.
Maximum unusual value =...
3.2K
Quantifying and Rejecting Outliers: The Grubbs Test
1.7K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.7K
Detection of Gross Error: The Q Test
6.3K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.3K
Outliers and Influential Points
4.1K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.1K
Survival Tree
119
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
119


