W-DOE:瓦瑟斯坦分布-不可知异常值暴露
概括
这项研究介绍了瓦瑟斯坦分布不可知异常值暴露 (W-DOE),这是一种改善分布外 (OOD) 检测的新方法. 通过合成多样化的OOD数据,W-DOE增强了模型的概括性,并减少了开放世界环境中的错误.
科学领域:
- 机器学习 机器学习
- 计算机视觉 计算机视觉
- 人工智能的人工智能
背景情况:
- 开放世界分类模型需要强大的分布外 (OOD) 检测能力.
- 异常值暴露 (OE) 增强了使用辅助OOD数据的模型,但可能会受到非代表性的OOD数据的影响.
- 现有的OE方法可以引入偏差,限制实际的OOD检测性能.
研究的目的:
- 提出一种基于OE的新型学习方法,Wasserstein分布不可知异常值暴露 (W-DOE),以改进OD检测.
- 通过扩大培训时间的OOD数据的覆盖范围来提高模型的稳定性.
- 为开放世界的设置提供理论保证,并为未见的OOD案例提供更好的概括.
主要方法:
- 介绍了瓦瑟斯坦的分布不可知异常值暴露 (W-DOE),这是一个理论上健全且在实验上优越的OE方法.
- 开发了隐式数据合成 (IDS),一种新的方法,通过扰乱模型参数来生成额外的OOD数据.
- 实施了通用学习框架,以优化合成的OOD数据,以获得最大的模型效益,用Wasserstein度量衡.
主要成果:
- 在各种OOD检测基准中,W-DOE与最先进的方法相比表现出了卓越的表现.
- 拟议的IDS方法有效地扩大了OOD数据覆盖范围,从而在部署期间减少了未见的OOD案例.
- 由W-DOE确保的更广泛的OOD覆盖率,导致估计错误减少,并改善了对现实世界OOD场景的概括性.
结论:
- W-DOE提供了一种理论上有基础的和经验验证的方法来提高开放世界的环境中的OOD检测.
- 该方法通过IDS合成各种OOD数据的能力显著提高了模型适应新型OOD数据的适应性.
- W-DOE提供了可证明的保证,确保在实际应用中更可靠,更准确的OOD检测性能.
更多相关视频
00:05In Silico Modeling Method for Computational Aquatic Toxicology of Endocrine Disruptors: A Software-Based Approach Using QSAR Toolbox
Published on: August 28, 2019
13.8K
16:02Demonstration of the Sequence Alignment to Predict Across Species Susceptibility Tool for Rapid Assessment of Protein Conservation
Published on: February 10, 2023
2.6K
相关概念视频
Quantifying and Rejecting Outliers: The Grubbs Test
1.4K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.4K
What Are Outliers?
3.6K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
3.6K
Outliers and Influential Points
3.9K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
3.9K
Detection of Gross Error: The Q Test
5.2K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
5.2K
Wald-Wolfowitz Runs Test II
171
The Wald-Wolfowitz runs test, commonly referred to as the runs test, is a nonparametric test used to assess the randomness of ordered data. The test evaluates the number of runs, which are consecutive sequences of similar elements within the data. If the number of runs is significantly higher or lower than expected, the data is considered non-random, indicating a detectable pattern or structure.
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and...
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and...
171
Wald-Wolfowitz Runs Test I
590
The Wald-Wolfowitz test, also known as the runs test, is a nonparametric statistical test used to assess the randomness of a sequence of two different types of elements (e.g., positive/negative values, successes/failures). It examines whether the order of the elements in a sequence is random or if there is a pattern or trend present. This nonparametric test applies to any ordered data despite the population and sample data distribution, even if a higher sample size is available.
The test works...
The test works...
590
