在双重噪音下可靠的短线学习
概括
本研究介绍了DEnoised Task Adaptation (DETA++),这是一种可靠的少量学习 (FSL) 的新方法. DETA++有效地减轻了支持和查询样本中的噪音,改善了在开放世界的场景中模型的适应性和预测准确性.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 短暂的学习 (FSL) 使用有限的数据调整预先训练的模型.
- 现有的FSL方法在支持和查询样本中与分布内 (ID) 和分布外 (OOD) 噪音作斗争.
- 在适应过程中噪声放大导致FSL中不可靠的预测.
研究的目的:
- 建议DEnoised任务适应 (DETA++) 进行强大的少量学习.
- 为了提高FSL模型在双重噪声 (ID和OOD) 存在时的可靠性.
- 用有限的标记数据来提高任务适应性和预测准确性.
主要方法:
- 开发了一个对比相关性聚合 (CoRA) 模块用于样本权重.
- 引入了清洁的原型损失和噪声最大化损失,以实现强大的适应.
- 采用了一个内存库和本地最接近的中心点分类器 (LocalNCC) 进行噪声强度预测.
- 利用一个类内部区域交换 (IntraSwap) 策略来纠正类原型.
主要成果:
- DETA++在适应噪音强度任务方面取得了显著的改进.
- 提出的方法有效地减轻了FSL中双重噪声的不利影响.
- 实验证实了DETA++框架的有效性和灵活性.
结论:
- DETA++提供了一种可靠的解决方案,可以应对噪音大数据所带来的少量学习挑战.
- 该方法提高了模型适应性和在开放世界环境中的预测性能.
- 该方法为防噪FSL提供了灵活有效的框架.
相关概念视频
Observational Learning
319
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
319
Difference from Background: Limit of Detection
7.1K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
7.1K
Introduction to Learning
545
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
545
Associative Learning
597
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
597
Multi-input and Multi-variable systems
152
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
152
Generalization, Discrimination, and Extinction
816
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
816
