基于侵入性的异常值而不是所有实例的特征选择
概括
本研究介绍了基于侵入性异常值的特征选择 (IOFS),这是一种新的特征选择方法,可以有效处理重叠类. 实验表明IOFS及其扩展E-IOFS提高了分类准确性,特别是在复杂的数据集.
科学领域:
- 机器学习 机器学习
- 数据挖掘 数据挖掘
- 模式识别 模式识别
背景情况:
- 传统的特征选择方法在高度重叠的类和倾斜的数据分布方面扎.
- 基于实例的方法往往忽略了异常值和主要类体之间的关键差异,导致错误分类.
- 识别和利用特定的异常值特征对于提高分类性能至关重要.
研究的目的:
- 提出一种新的监督特征选择方法,即基于侵入性异常值的特征选择 (IOFS).
- 为了应对错误分类的挑战,由于类别重叠的数据集中的侵入性异常值造成的.
- 为了更有效地选择特征,利用侵入性异常值的独特特征.
主要方法:
- 开发了一种密度-平均中心算法,以准确识别类代表和侵入性异常值 (IO).
- 引入了特定的距离值和数学公式来评估侵入性类对的重叠程度.
- 建议扩展,E-IOFS,专注于极端侵入性异常值的一小部分.
主要成果:
- IOFS有效地将高重叠度较低的特征排名较低,从而改善了分类.
- 针对11个基准数据集的实验证明了IOFS的合理性和有效性,特别是对于高类重叠的数据集.
- 扩展的方法,E-IOFS,在大多数实验环境中始终超过IOFS.
结论:
- 在具有挑战性的数据分布的情况下,IOFS提供了一种强大的方法来选择特征.
- 该方法成功地利用侵入性的异常值特征来提高分类器的性能.
- 通过专注于极端异常值,E-IOFS提供了更精细,往往更优越的特征选择策略.
相关概念视频
Outliers and Influential Points
4.1K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.1K
Quantifying and Rejecting Outliers: The Grubbs Test
1.6K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.6K
What Are Outliers?
3.9K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
3.9K
Detection of Gross Error: The Q Test
6.1K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.1K
Survival Tree
86
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
86
Modified Boxplots
9.7K
A standard box and whisker plot informs us about the spread of the data in a given sample. One can identify the minimum value, maximum value, first quartile value, second quartile or median value, and third quartile.
However, the box plot does not tell the reader about outliers - values that lie far from the center of the data. We can modify the standard box and whisker plot to identify the outliers and visualize the actual spread of the data in a sample.
Initially, we calculate the adjusted...
However, the box plot does not tell the reader about outliers - values that lie far from the center of the data. We can modify the standard box and whisker plot to identify the outliers and visualize the actual spread of the data in a sample.
Initially, we calculate the adjusted...
9.7K


