坏标签:评估和增强标签噪音学习的强有力的视角
IEEE transactions on pattern analysis and machine intelligence
|January 18, 2024
概括
研究人员推出了BadLabel,这是一个新的噪音类型,它挑战了现有的标签噪音学习 (LNL) 算法. 开发了一种新的强大的LNL方法来应对BadLabel,改善了对噪音数据集的模型概括性.
科学领域:
- 机器学习 机器学习
- 计算机视觉 计算机视觉
- 人工智能的人工智能
背景情况:
- 标签无噪音学习 (LNL) 解决了不准确数据的培训模型中的挑战.
- 现有的LNL算法容易受到各种类型的噪音的影响,包括类条件和依赖实例的噪音.
- 随着新的,复杂的标签噪声模式,观察到显著的性能下降.
研究的目的:
- 引入一个新的,具有挑战性的标签噪音类型,名为BadLabel.
- 开发一个强大的LNL方法,以减轻BadLabel和其他噪音类型的影响.
- 在有噪音训练数据的情况下增强模型概括能力.
主要方法:
- 通过翻转特定样本的标签来制造BadLabel,在干净和杂数据之间创建无法区分的损失值.
- 提出一个强大的LNL方法,包括在训练期间对抗标签扰乱.
- 在一小部分清洁标记数据上使用半监督学习技术,以减轻噪音后的噪音.
主要成果:
- 证明了当前LNL算法对BadLabel噪音类型的脆弱性.
- 展示了拟议的强大的LNL方法在改善各种噪音类型的泛化方面的有效性.
- 通过对新生成的噪音数据集的经验实验验证实了该方法.
结论:
- 坏标签对现有的标签噪声学习算法构成重大威胁.
- 提出的对抗性标签扰动方法为LNL提供了一个强大的解决方案.
- 开发的技术提高了模型性能和在现实世界杂数据场景中的概括性.
相关概念视频
01:05Difference from Background: Limit of Detection
6.4K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
6.4K
01:24Generalization, Discrimination, and Extinction
563
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
563
01:21Perceiving Loudness, Pitch, and Location
214
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
214
01:27Associative Learning
375
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
375
01:30Classification of Signals
466
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
466
01:21Cognitive Learning
243
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
243