二国間配給スコアで配給外検出の強化
Bolun Zheng1, Yuhao Lin1, Yao Zhu2
1School of Automation, Hangzhou Dianzi University, Hangzhou, 310018, China.
まとめ
この研究は,機械学習における改善されたアウト・オブ・ディストリビューション (OOD) 検出のための二国間分布スコア (BDS) を導入します. BDSは,モデルの再訓練なしにOODサンプルを効果的に識別することにより,信頼性を高めます.
科学分野:
- 機械学習 (Machine Learning) とは,機械学習 (Machine Learning) について学ぶことです.
- 人工知能 (AI) とは,人工知能 (AI) のことです.
- コンピュータビジョン コンピュータビジョン
背景:
- 配給外 (OOD) の検出は,安全性の重要なシステムにおける信頼性の高いAIにとって不可欠です.
- 既存の方法は,分類者の過度の自信と欺瞞的なOODサンプルと闘っています.
- 現在のポストホックOOD検出方法は,特定のOODデータ分布に対して堅実な性能を欠いている.
研究 の 目的:
- 既存のアプローチの限界を克服する新しいOOD検出方法を開発する.
- "理想的なOODサンプル"のコンセプトに基づく新しいOODスコアメカニズムを導入する.
- 現実世界のアプリケーションにおける機械学習モデルの信頼性と安全性を高める.
主な方法:
- 特徴空間におけるすべてのクラスセンターから同距離の"理想的なOODサンプル"の概念を提案した.
- この理想的なOODサンプルとの類似性に基づいて新しいOODスコアを定義しました.
- OODとインディストリビューション (ID) のスコアを統合した二国間配送スコア (BDS) を導入しました.
主要な成果:
- BDSは,ImageNet-1kとCIFAR-10のベンチマークで優れたOOD検出能力を実証しました.
- 最先端の方法と比較して95% (FPR95) の平均偽陽性率を10.78%削減しました.
- この方法は,アーキテクチャの変更や再訓練を必要とせず,後方互換性を保証します.
結論:
- BDSはOOD検出の重要な進歩を提供し,モデルの信頼性を向上させます.
- 提案された方法は効果的で実用的で,既存の技術とシームレスに統合できます.
- BDSは,OODサンプルに対する機械学習モデルの堅実性を高めます.
関連する概念動画
Quantifying and Rejecting Outliers: The Grubbs Test
4.2K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
4.2K
Detection of Gross Error: The Q Test
7.1K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
7.1K
Outliers and Influential Points
6.4K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
6.4K
What Are Outliers?
5.3K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
5.3K
The Anderson-Darling Test
1.2K
The Anderson-Darling test is a statistical method used to determine whether a data sample is likely drawn from a specific theoretical distribution. Unlike parametric tests, it does not require assumptions about specific parameters of the distribution. Instead, it compares the sample's empirical cumulative distribution function (ECDF) with the cumulative distribution function (CDF) of the hypothesized distribution. Critical values for the test are specific to the chosen distribution rather...
1.2K
Introduction to Normal Distributions
90
Standardized test scores often follow a symmetric distribution that can be modeled with the normal distribution, a fundamental concept in statistics. This distribution is particularly useful for interpreting test performance fairly across populations, as it provides a mathematical framework for understanding variability and central tendency in large datasets.From Histogram to Frequency DistributionRaw test data are often displayed using histograms, where the height of each bar represents the...
90

