通过对合成负数据进行强有力的学习来检测密集的分布外检测
Matej Grcić1, Petra Bevandić1, Zoran Kalafatić1
1Faculty of Electrical Engineering and Computing, University of Zagreb, 10000 Zagreb, Croatia.
Sensors (Basel, Switzerland)
|February 24, 2024
概括
本研究引入了一种新的方法,通过生成合成负样本来检测密集预测任务中的分布外 (OOD) 数据. 这种方法提高了模型可靠性,并为关键应用中OOD检测设定了新的基准.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 标准机器学习模型在训练数据分布之外的输入中扎,导致自信但不正确的预测.
- 密集的预测任务,如图像分析,特别容易受到攻击,因为异常可能是局部的.
- 现有的使用真负数据集的分布外检测方法可能会因为数据重叠而高估性能.
研究的目的:
- 开发一种可靠的方法,用于密集的分布外检测.
- 为了解决使用真负数据集用于培训和评估的局限性.
- 提高机器学习模型在现实世界,不可预测的场景中的可靠性.
主要方法:
- 在内置分流的边界沿着生成合成负数据补丁.
- 使用共同训练的规范化流程,以覆盖面为导向的学习目标.
- 在训练和推断过程中使用原则性的信息理论标准来检测异常.
主要成果:
- 拟议的方法在分销之外的检测基准上实现了最先进的性能.
- 在道路驾驶场景和遥感图像中表现出有效性.
- 在最小的额外计算成本下取得卓越的结果.
结论:
- 产生合成负数据的新方法显著提高了分布之外的检测能力.
- 该方法提供了一种更可靠和原则性的方法来识别密集预测中的异常输入.
- 这项研究为在安全关键应用中部署机器学习提供了重大进展.
更多相关视频
相关概念视频
Outliers and Influential Points
4.0K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.0K
Quantifying and Rejecting Outliers: The Grubbs Test
1.6K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.6K
What Are Outliers?
3.8K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
3.8K
Detection of Gross Error: The Q Test
6.1K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.1K
Data: Types and Distribution
722
In biostatistics, data are the observations collected for analysis. There are two main types: parametric and non-parametric. Parametric data, which include continuous (e.g., weight) and discrete numerical data (e.g., number of tablets), assume a particular distribution pattern, often the normal distribution. Non-parametric data do not adhere to a specific distribution and typically comprise nominal (e.g., gender) and ordinal categorical data (e.g., pain scale ratings).
Distributions in...
Distributions in...
722
Difference from Background: Limit of Detection
6.4K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
6.4K


