机器学习用于异常模式的复杂系统,通过异常最大化异常值检测
Zhikun Zhang1, Yiting Duan2, Xiangjun Wang1
1School of Mathematics and Statistics, Huazhong University of Science and Technology, Wuhan 430074, China.
Chaos (Woodbury, N.Y.)
|April 10, 2025
概括
新的例外最大化异常值检测 (EMOD) 算法有效地使用实时数据在复杂系统中发现异常. 它准确地检测系统故障,并识别经济数据中的不寻常时期.
科学领域:
- 数据科学数据科学数据科学
- 统计建模 统计建模
- 机器学习 机器学习
背景情况:
- 检测复杂系统输出中的异常模式对于系统可靠性和理解至关重要.
- 现有的异常值检测方法往往需要事先的分布信息,或者不适合实时应用.
研究的目的:
- 引入一种新的,快速的在线方法来检测异常值:异常最大化异常值检测 (EMOD) 算法.
- 在不依赖于先前的分布信息的情况下,在合成和现实世界数据集上展示算法的有效性.
主要方法:
- EMOD算法使用双态高斯混合模型进行概率异常检测.
- 它处理实时原始数据,使得在线和快速的异常标识.
- 统计算法用于分析复杂系统的输出.
主要成果:
- EMOD在从两个数值案例中合成数据上的概率异常检测中表现出强的表现.
- 该算法成功地识别了电路系统中的短路模式,使用来自三相逆变器的电流和电压数据.
- EMOD检测到与COVID-19相关的美国保险失业数据 (2000-2024) 中出现了异常时期.
结论:
- 异常最大化异常值检测 (EMOD) 算法是实时异常值检测的有效和准确工具.
- EMOD能够使用原始数据并检测各种异常的能力突显了其多功能性和实际应用性.
相关概念视频
Outliers and Influential Points
3.9K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
3.9K
What Are Outliers?
3.6K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
3.6K
Quantifying and Rejecting Outliers: The Grubbs Test
1.4K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.4K
Detection of Gross Error: The Q Test
4.8K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
4.8K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
34
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
34
Classification of Systems-I
161
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
161


