强大的学习的动态损失
IEEE transactions on pattern analysis and machine intelligence
|September 4, 2023
概括
这项研究引入了一种新的元学习动态损失,以解决数据集中的标签噪声和类不平衡. 该方法有效地纠正噪音标签,并产生分类边缘,用于对具有挑战性的数据进行强有力的学习.
科学领域:
- 机器学习 机器学习
- 计算机视觉 计算机视觉
- 数据科学数据科学数据科学
背景情况:
- 现实世界数据集经常表现出标签噪音和类不平衡,阻碍了强大的模型训练.
- 现有的方法经常单独解决这些问题,导致当两者都存在时性能下降.
研究的目的:
- 开发一种统一的方法,从标签噪声和类不平衡的数据集中进行强有力的学习.
- 引入一种新的基于元学习的动态损失函数,以提高对偏差数据的分类器性能.
主要方法:
- 提出了一个基于meta-learning的动态损失,包括一个标签校正器和一个保证金生成器.
- 采用分层采样策略,以多样化和具有挑战性的样本丰富培训数据.
- 动态损失组件通过meta-learning共同优化,以适应清洁和平衡的测试数据.
主要成果:
- 拟议的方法在多个真实世界和合成数据集上展示了最先进的准确性.
- 在包括CIFAR-10/100,Animal-10N,ImageNet-LT和Webvision在内的数据集上进行了实验.
- 该方法有效地处理各种数据偏差,包括长尾杂数据.
结论:
- 新的动态损失有效地解决了标签噪音和阶级不平衡的联合挑战.
- 超级学习框架能够对清洁和平衡的数据分布进行强有力的适应.
- 这项工作为现实世界的应用提供了强大的学习技术的重大进步.
更多相关视频
相关概念视频
Reducing Line Loss
173
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
173
Avoidance Learning and Learned Helplessness
1.8K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.8K
Line Loss
266
The different configurations of source-load connections include wye (star) and delta connections. The relationship between line and phase voltages and currents varies depending on the configuration. When the source is supplying power, it is transmitted through the wires to the load, and during this transmission, some power is absorbed by the wires, leading to line loss.
Line loss impacts power delivery efficiency in a balanced three-phase circuit. The symmetry in such a circuit simplifies the...
Line loss impacts power delivery efficiency in a balanced three-phase circuit. The symmetry in such a circuit simplifies the...
266
Introduction to Learning
470
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
470
Survival Tree
109
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
109
Observational Learning
209
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
209


