通过梯度向量进行分布之外的检测
Thiago Carvalho1, Marley Vellasco2, José Franco Amaral3
1Department of Electrical Engineering - Pontifical Catholic University of Rio de Janeiro, R. Marques de Sao Vincente 124, Rio de Janeiro, 22451-040, Rio de Janeiro, Brazil; Department of Systems and Computing Engineering - Rio de Janeiro State University, R. S. Francisco Xavier 524, Rio de Janeiro, 20950-000, Rio de Janeiro, Brazil.
概括
这项研究介绍了GradVec,这是一种在深度学习中用于分布外 (OOD) 检测的新方法. 格拉德维克使用模型模型.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算机视觉 计算机视觉
背景情况:
- 在现实世界中,深度学习的部署需要处理不受控制的输入数据.
- 在已知类别之外的样品的识别,OOD检测非常重要.
- 现有的OOD方法往往忽视了梯度空间的潜力.
研究的目的:
- 介绍GradVec,一个新的OD检测方法家族.
- 探索梯度空间在OOD检测中的实用性.
- 在现实场景中提高深度学习模型的稳定性.
主要方法:
- 拟议的GradVec方法利用梯度特征进行OOD检测.
- 利用梯度空间作为OOD检测技术的输入表示.
- 在不改变培训程序的情况下,将GradVec应用于预先训练的模型.
主要成果:
- 在OOD检测任务中,GradVec表现出卓越的性能.
- 在图像分类方面,在95%的FPR (FPR95) 中显著降低了假阳性率 (高达26.67%).
- 在文本分类方面表现出有效性,将FPR95降低了高达21.29%.
结论:
- 梯度空间为OOD检测提供了一个有信息的表示.
- 格拉德维克为增强模型安全提供了一种多功能和有效的方法.
- 该方法适用于任何预训练模型,没有额外的数据或训练修改.
相关概念视频
Gradient and Del Operator
4.3K
In mathematics and physics, the gradient and del operator are fundamental concepts used to describe the behavior of functions and fields in space. The gradient is a mathematical operator that gives both the magnitude and direction of the maximum spatial rate of change. Consider a person standing on a mountain. The slope of the mountain at any given point is not defined unless it is quantified in a particular direction. For this reason, a "directional derivative" is defined, which is a vector...
4.3K
Outliers and Influential Points
6.1K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
6.1K
Quantifying and Rejecting Outliers: The Grubbs Test
3.5K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
3.5K
What Are Outliers?
4.9K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
4.9K
Detection of Gross Error: The Q Test
6.9K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.9K
Difference from Background: Limit of Detection
8.0K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
8.0K


