OOD-CV-v2 : 一个扩展的基准,用于对自然图像中的个体干扰的分布外转移的稳定性
IEEE transactions on pattern analysis and machine intelligence
|September 17, 2024
概括
一个新的基准数据集,OD-CV-v2,解决了计算机视觉稳定性测试的局限性. 它揭示了当前的方法提供了最小的改进,一些麻烦因素显著降低了各种视觉任务的性能.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 现实世界的计算机视觉强度受到有限的基准标准的挑战.
- 现有的数据集往往使用合成数据或忽略个别的麻烦因素.
研究的目的:
- 介绍OOD-CV-v2,这是一个用于分布外计算机视觉的基准.
- 启用强大的基准测试用于图像分类,物体检测和3D姿势估计.
主要方法:
- 开发了OOD-CV-v2与各种分布之外的例子 (姿势,形状,纹理,上下文,天气).
- 在新基准上使用流行的基线方法进行实验.
主要成果:
- 识别了视觉任务中扰因素的不同负面影响.
- 观察到当前强度增强方法的边际甚至有害影响.
- 在卷积架构和变压器架构之间没有发现显著的性能差异.
结论:
- OOD-CV-v2是研究计算机视觉强度的宝贵资源.
- 目前的稳健性战略需要大幅度改进.
- 需要进一步的研究来推进强大的视觉算法.
相关概念视频
Difference from Background: Limit of Detection
6.0K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
6.0K
Mean Absolute Deviation
2.6K
The mean absolute deviation is also a measure of the variability of data in a sample. It is the absolute value of the average difference between the data values and the mean.
Let us consider a dataset containing the number of unsold cupcakes in five shops: 10, 15, 8, 7, and 10. Initially, calculate the sample mean. Then calculate the deviation, or the difference, between each data value and the mean. Next, the absolute values of these deviations are added and divided by the sample size to...
Let us consider a dataset containing the number of unsold cupcakes in five shops: 10, 15, 8, 7, and 10. Initially, calculate the sample mean. Then calculate the deviation, or the difference, between each data value and the mean. Next, the absolute values of these deviations are added and divided by the sample size to...
2.6K
Detection of Gross Error: The Q Test
5.7K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
5.7K
Quantifying and Rejecting Outliers: The Grubbs Test
1.5K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.5K
Survival Tree
66
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
66
Coefficient of Variation
3.8K
The coefficient of variation measures the dispersion of the data points or distribution around the mean. Using the coefficient of variation, we can compare two data series with drastically different means or different units of measurement. The coefficient of variation for a sample and a population is expressed as a percentage of the ratio of standard deviation to the mean.
The coefficient of variation is a practical statistical tool in finance. It allows investors to assess the volatility or...
The coefficient of variation is a practical statistical tool in finance. It allows investors to assess the volatility or...
3.8K


