学习检测工业时间序列异常从计算一致性与稀缺的观测
概括
本研究引入了一种用于检测工业时间序列数据中缺失值的异常的新方法. 该方法使用归算一致性来准确识别稀疏的观测序列中的问题.
科学领域:
- 工业安全 工业安全 工业安全
- 数据科学数据科学数据科学
- 机器学习 机器学习
背景情况:
- 时间序列异常检测对于工业安全至关重要.
- 现有的方法经常在不完整的现实数据下失败.
- 缺少数据在实际应用中是一个重大挑战.
研究的目的:
- 提出一种新的异常检测方法,用于稀疏观测的时间序列.
- 为了解决当前处理缺失数据的方法的局限性.
- 引入一种基于归算一致性的新方法.
主要方法:
- 开发了一种混合补丁信息推断网络 (MoPIN).
- 通过比较来自不同随机面具的归算序列,利用归算一致性.
- 采用两步归算和补丁信息的多尺度建模.
主要成果:
- 在四个现实世界的基准和流体催化裂变过程案例中,MoPIN证明了有效性.
- 实现了至少8.05%的平均绝对误差 (MAE) 对归算的相对改善.
- 在异常检测方面获得了3.74%的F1相对改善.
结论:
- 拟议的MoPIN方法准确地检测稀疏时间序列数据中的异常.
- 推算一致性是一种可行的策略,用于检测缺失值的异常.
- MoPIN有效地同时处理归算和异常检测任务.
相关概念视频
Steps in Outbreak Investigation
102
In the ever-evolving field of public health, statistical analysis serves as a cornerstone for understanding and managing disease outbreaks. By leveraging various statistical tools, health professionals can predict potential outbreaks, analyze ongoing situations, and devise effective responses to mitigate impact. For that to happen, there are a few possible stages of the analysis:
102
Detection of Gross Error: The Q Test
5.0K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
5.0K
Quantifying and Rejecting Outliers: The Grubbs Test
1.4K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.4K
Outliers and Influential Points
3.9K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
3.9K
Random Error
798
Random or indeterminate errors originate from various uncontrollable variables, such as variations in environmental conditions, instrument imperfections, or the inherent variability of the phenomena being measured. Usually, these errors cannot be predicted, estimated, or characterized because their direction and magnitude often vary in magnitude and direction even during consecutive measurements. As a result, they are difficult to eliminate. However, the aggregate effect of these errors can be...
798
Estimating Population Mean with Unknown Standard Deviation
7.6K
In practice, we rarely know the population standard deviation. In the past, when the sample size was large, this did not present a problem to statisticians. They used the sample standard deviation s as an estimate for σ and proceeded as before to calculate a confidence interval with close enough results. However, statisticians ran into problems when the sample size was small. A small sample size caused inaccuracies in the confidence interval.
William S. Gosset (1876–1937) of the...
William S. Gosset (1876–1937) of the...
7.6K


