通过本地化实现损失导向失衡学习的统一视角
IEEE transactions on pattern analysis and machine intelligence
|September 12, 2025
概括
本研究引入了局部性质来分析类不平衡的学习,改进了以损失为导向的方法. 基于这些见解的新算法增强了机器学习模型中少数类的概括性.
科学领域:
- 机器学习 机器学习
- 人工智能的人工智能
- 计算机科学 计算机科学
背景情况:
- 现实世界的数据集往往表现出阶级不平衡,使实证风险最小化 (ERM) 偏向于多数类.
- 现有的损失修改方法 (重权,逻辑调整) 缺乏细粒度分析,无法完全解释经验结果.
- 目前的分析使用全球性属性,不充分地捕捉了类依赖术语对学习动态的影响.
研究的目的:
- 为改进和调整机器学习中的以损失为导向的方法制定统一的观点.
- 解决全球财产分析在理解阶级不平衡学习方面的局限性.
- 提出一个基于原则的学习算法,增强对少数阶级的概括性.
主要方法:
- 在每个类中定义的属性的本地化版本的探索,以分析学习动态.
- 局部校准的应用,用于在各种损失函数中验证一致性.
- 利用局部化的利普希茨连续性来导出细粒度的泛化边界.
主要成果:
- 一个统一的理论框架,用于理解和改进失衡数据的损失导向方法.
- 开发一种基于局部分析的新型学习算法.
- 在ResNets和基础模型上对理论发现和算法有效性的实证验证.
结论:
- 本地化属性为分析和完善类不平衡的学习策略提供了更有效的镜头.
- 提出的基于原则的学习算法在概括方面取得了显著的改进,特别是在少数群体中.
- 这些发现为解决机器学习中的阶级不平衡提供了一种连贯的方法.
相关概念视频
01:18Reducing Line Loss
367
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss in...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss in...
367
01:12Observational Learning
843
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
843
01:27Associative Learning
1.3K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.3K
02:07Improving Translational Accuracy
3.6K
3.6K
02:07Improving Translational Accuracy
14.1K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
14.1K
01:14Avoidance Learning and Learned Helplessness
2.5K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
2.5K