通过基于两阶段学习的集体学习改善不平衡分类
Na Liu1, Jiaqi Wang1, Yongtong Zhu1
1Institute of Machine Intelligence, University of Shanghai for Science and Technology, Shanghai, China.
Frontiers in computational neuroscience
|January 22, 2024
概括
本研究引入了一种新的两阶段学习方法,以解决图像分类的深度学习中的数据不平衡. 该方法通过重新权重样本并使用合并方法来减轻分布变化,从而改善不平衡数据集的模型性能.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 深度神经网络需要大,高质量的数据集,以获得最佳的图像分类性能.
- 现实世界数据集经常表现出偏差分布,导致由于先前和共变量转移而导致性能退化.
- 现有的两阶段学习方法在维护网络表达能力和应对共变量转移方面扎.
研究的目的:
- 开发一种强大的方法来处理深度神经网络中不平衡的数据集.
- 通过解决先前和共变量转移来改善模型性能.
- 加强在不平衡数据上训练的网络的代表性能力.
主要方法:
- 建议采用样本逻辑意识重权 (SLA) 方法来调整多数和少数类样本的重量.
- 集成的SLA与logit调整,提供稳定的两阶段学习策略.
- 开发了一个多领域专家专业化模型,灵感来自于合体学习,以应对共变量转移.
主要成果:
- 提出的方法有效地修复了多数类的硬样品和少数类的样品的重量.
- SLA和逻辑调整的结合方法形成了一个稳定的两阶段学习策略.
- 多领域专家模型通过在不同领域中平均专家分类来改善决策.
- 在CIFAR-LT和ImageNet-LT数据集上的实验结果表明,与最先进的方法相比,性能优越.
结论:
- 开发的两阶段学习方法成功地解决了不平衡数据集中的先前和共变量转移.
- 样本逻辑意识重权和多域专家专业化为图像分类的深度学习提供了显著的改进.
- 拟议的模型在挑战CIFAR-LT和ImageNet-LT等不平衡数据集时取得了出色的性能.
相关概念视频
Classification of Systems-II
146
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
146
Classification of Systems-I
188
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
188
Aggregates Classification
326
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
326
Force Classification
1.2K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.2K
Classification of Signals
466
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
466
Associative Learning
375
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
375


