通过局部颗粒球密度识别异常值
概括
本研究介绍了基于颗粒球密度的局部异常值 (GBDO) 检测,这是一种通过处理多个颗粒度的数据来改进异常值检测的新方法. 与传统方法相比,GBDO提高了稳定性并降低了计算复杂性.
科学领域:
- 数据挖掘 数据挖掘
- 机器学习 机器学习
- 计算智能是一种计算智能.
背景情况:
- 现有的基于密度的异常值检测方法在单个数据细分度上运行,导致对噪声的高度敏感性和无法捕获多层次信息.
- 这些方法往往忽视数据的不确定性,如模糊性,妨碍有效的异常值检测.
研究的目的:
- 提出一种新的异常值检测方法,即局部基于颗粒球密度的异常值 (GBDO),利用颗粒球计算 (GBC).
- 通过解决单颗粒度处理和不确定性处理的局限性,提高基于密度的异常值检测的性能.
主要方法:
- 使用颗粒球计算 (GBC) 进行多颗粒度数据处理.
- 根据模糊关系识别k-相似的颗粒球 (GB) 社区.
- 计算 GBs 的本地可访问性相似性密度.
- 为样本计算本地GB异常因子.
主要成果:
- GBDO采用了使用GB作为基本单位的多细分处理范式.
- 这种方法减少了计算复杂性,并增加了对噪音数据的稳定性.
- 实验结果验证了GBDO对最先进方法的有效性.
结论:
- 通过整合多颗粒度处理和稳定性,GBDO为异常值检测提供了有效的解决方案.
- 该方法成功地克服了传统单颗粒度密度为基础的方法的局限性.
- 拟议的GBDO方法在识别异常值方面表现出卓越的性能.
相关概念视频
Quantifying and Rejecting Outliers: The Grubbs Test
2.0K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
2.0K
What Are Outliers?
4.2K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
4.2K
Detection of Gross Error: The Q Test
6.4K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.4K
Outliers and Influential Points
4.2K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.2K
Bulk Density of Aggregate
654
Bulk density refers to the mass of aggregate particles that would fill a unit volume. The concept of bulk density originates from the inability to pack aggregate particles in a manner that completely eliminates void spaces. Hence, the term bulk refers to the volume that encompasses both the aggregates and the voids. This measurement is crucial when aggregates are batched by volume and is used to convert quantities by mass to volume.
Most natural mineral aggregates, like sand and gravel,...
Most natural mineral aggregates, like sand and gravel,...
654
Specific Gravity of Aggregate
379
Aggregates typically contain pores, which can be either permeable or impermeable. Considering the pores in the aggregates, the specific gravity of aggregates is defined in three different forms, namely, bulk or gross specific gravity, apparent specific gravity, and absolute specific gravity.
Bulk or gross specific gravity is calculated by taking the ratio of the mass of aggregates in the saturated surface-dry state to the total volume that includes both the solids and the voids within the...
Bulk or gross specific gravity is calculated by taking the ratio of the mass of aggregates in the saturated surface-dry state to the total volume that includes both the solids and the voids within the...
379


