当一个额外的拒绝类在长尾图像分类中遇到分布外检测时
1State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, 210023, China; Department of Computer Science and Technology, Nanjing University, Nanjing, 210023, China.
概括
这项研究引入了一种新的三分支框架,用于在长尾图像分类中进行强大的分布外 (OOD) 检测. 该方法通过使用拒绝类和辅助异常值数据有效处理不平衡的数据.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 可靠的深度学习需要有效的OOD输入检测.
- 现有的OOD检测方法与不平衡,长尾训练数据分布作斗争.
- 开放世界的应用程序需要强大的OOD检测可靠的AI系统.
研究的目的:
- 为长尾图像分类开发一个有效的OOD检测框架.
- 解决当前OOD检测方法对不平衡数据集的局限性.
- 在现实,开放世界的场景中提高深度学习模型的可靠性.
主要方法:
- 一个包含拒绝类和辅助异常值数据的三分支训练框架.
- 将所有异常训练样本分配到拒绝类标签上.
- 使用内置损失,外置损失和尾部类原型诱导的监督对比损失 (TSCL) 进行统一的网络训练.
主要成果:
- 拟议的方法在长尾图像分类中展示了优越的OOD检测性能.
- 在CIFAR100-LT上,与异常风险 (OE) 相比,平均AUROC有1.23%的改善,平均FPR95有3.18%的减少.
- 使用拒绝类构建的OOD检测器在推理过程中证明有效.
结论:
- 拟议的三分支框架有效地提高了对长尾分布的OOD检测.
- 整合一个拒绝类和辅助异常值数据对于强大的OOD检测至关重要.
- 该方法在现实世界的深度学习应用中比现有技术有了显著的改进.
相关概念视频
Quantifying and Rejecting Outliers: The Grubbs Test
1.5K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.5K
Detection of Gross Error: The Q Test
6.0K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.0K
What Are Outliers?
3.8K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
3.8K
Outliers and Influential Points
4.0K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.0K
Unusual Results
3.2K
Unusual results are those that have a very low chance of occurring. Unusual results can be identified using probabilities and the range rule of thumb. In problems involving probability, unusual results can be observed in 2 instances – an unusually high number of successes or an unusually low number of successes.
According to the range rule of thumb, any value above or below two standard deviations, 2σ from the mean, μ is considered unusual.
Maximum unusual value =...
According to the range rule of thumb, any value above or below two standard deviations, 2σ from the mean, μ is considered unusual.
Maximum unusual value =...
3.2K
Modified Boxplots
9.5K
A standard box and whisker plot informs us about the spread of the data in a given sample. One can identify the minimum value, maximum value, first quartile value, second quartile or median value, and third quartile.
However, the box plot does not tell the reader about outliers - values that lie far from the center of the data. We can modify the standard box and whisker plot to identify the outliers and visualize the actual spread of the data in a sample.
Initially, we calculate the adjusted...
However, the box plot does not tell the reader about outliers - values that lie far from the center of the data. We can modify the standard box and whisker plot to identify the outliers and visualize the actual spread of the data in a sample.
Initially, we calculate the adjusted...
9.5K


