ワイルドな分布外検出を克服するための2つの側面について
Abstract:
Out-of-distribution (OOD) detection serves as an unknown-handling mechanism for open-world classification, enabling the identification of OOD data that diverge semantically from in-distribution (ID) data. The learning strategy known as outlier exposure (OE) enhances this process by incorporating OODdataduring model training, directly making models learn to discern between ID and OOD patterns. However, in practice, the collected OOD data often contain many ID semantics, of which the scenario is commonly referred to as wild OOD detection. It can markedly compromise the reliability of models in OOD detection, yet few studies have addressed this critical issue. In this paper, we theoretically analyze wild OOD detection from the instance and distribution facets, respectively, to better comprehend its challenges and accordingly introduce two general solutions. At the instance facet, ID/OOD indicators contain errors due to the wild nature, where some data are of OOD labels yet should be assigned as ID. Hence, we introduce a general framework that can dynamically estimate the true ID/OOD indicators solely based on wild OOD data, thereby mitigating their negative impacts. At the distribution facet, the wild OOD distribution is a mixture of ID and OOD distributions, where the ID sub-distribution can mislead the model. We therefore propose a resampling scheme to remove the potential ID sub distribution, with resampling probabilities estimated from the known ID distribution, enabling OE training to better address wild OOD detection. We provide theoretical guarantees for both solutions and develop algorithms that enhance their practical efficacy, ultimately integrating them into a unified framework that leverages their complementary strengths. Ultimately, we validate our approaches through comprehensive empirical evaluations across a range of wild OOD detection scenarios, clearly demonstrating the superior performance and reliability of our methods when compared to advanced counterparts.
さらに関連する動画
08:23Single Droplet Digital Polymerase Chain Reaction for Comprehensive and Simultaneous Detection of Mutations in Hotspot Regions
Published on: September 25, 2018
10:41Wild-type Blocking PCR Combined with Direct Sequencing as a Highly Sensitive Method for Detection of Low-Frequency Somatic Mutations
Published on: March 29, 2017
関連する概念動画
Distribution Reliability and Automation
Difference from Background: Limit of Detection
The LOD indicates the presence or absence...
Censoring Survival Data
Quantifying and Rejecting Outliers: The Grubbs Test
Masking and Demasking Agents
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
Types of Errors: Detection and Minimization
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
