从统计数据转向基于假设的异常值
Alexander von Eye1, Wolfgang Wiedermann2
1Michigan State University, 190 Allee du Nouveau Monde, 34000, Montpellier, France. voneye@msu.edu.
这项研究引入了一种新的方法来分析分类数据中的异常值,通过它们与假设相对的极端来定义异常值. 配置频率分析 (CFA) 揭示了不受监督的异常值检测如何扭曲受监督分类结果.
科学领域:
- 统计 统计 统计 统计
- 数据挖掘 数据挖掘
- 分类数据分析 分类数据分析
背景情况:
- 传统的异常值分析依赖于数据特征,如距离或相关性.
- 这种方法适用于各种数据类型和分析尺度.
- 在定义基于实质假设的异常值方面存在差距.
研究的目的:
- 提出一种新的方法来分析分类数据中的异常值.
- 将异常值定义为与实质假设相对极端的数据点.
- 将标准异常值分析与配置频率分析 (CFA) 进行比较.
主要方法:
- 建议根据实质假设的极端性来定义异常值.
- 引入了两步异常值分析:标准分析和CFA.
- 使用集群分析进行无监督分类,使用CFA进行监督分类.
主要成果:
- 通过无监督分类确定的异常值可能会扭曲监督分类结果.
- 配置频率分析 (CFA) 将异常值确定为与零假设相矛盾的单元.
- 研究了无监督和监督分类方法之间的相互作用.
结论:
- 介绍了对分类数据中异常值定义的新视角.
- 配置频率分析提供了一个以假设为导向的方法来检测异常值.
- 了解无监督异常值识别对监督方法的影响至关重要.
更多相关视频
07:34Probing the Limits of Egg Recognition Using Egg Rejection Experiments Along Phenotypic Gradients
Published on: August 22, 2018
20:24Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study
Published on: January 31, 2014
相关概念视频
Quantifying and Rejecting Outliers: The Grubbs Test
Outliers and Influential Points
Detection of Gross Error: The Q Test
What Are Outliers?
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
Statistical Hypothesis Testing
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
