通过三向颗粒式计算探索多颗粒度平衡策略,通过三向颗粒式计算实现课堂增量学习
1Chongqing Key Laboratory of Computational Intelligence, Chongqing University of Posts and Telecommunications, No.2 Chongwen Road, Chongqing, 400065, China.
Brain informatics
|March 17, 2025
概括
班级增量学习 (CIL) 面临着由于记忆有限而导致的灾难性遗忘. 我们的多细分平衡策略 (MGBCIL) 通过平衡新旧数据,提高准确性和减少遗忘来缓解这一问题.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算机视觉 计算机视觉
背景情况:
- 班级增量学习 (CIL) 能够从数据流中持续学习.
- 灾难性遗忘仍然是CIL的一个重大挑战.
- 现有的情节性记忆重播方法面临缓冲区的限制,导致数据不平衡.
研究的目的:
- 提出一种新的CIL方法,MGBCIL,解决数据不平衡和灾难性遗忘.
- 为了利用灵感来自于颗粒式计算的多颗粒度平衡策略.
- 在增量学习场景中提高绩效.
主要方法:
- 引入了多细分平衡策略 (MGBCIL),采用批量,任务和决策层次的方法.
- 使用加权的交叉损失与批处理的平滑.
- 利用对比式学习和知识蒸来进行阶级分离和知识保存.
主要成果:
- 在CIFAR-10和CIFAR-100数据集上,MGBCIL表现出比现有方法更好的性能.
- 在特定的设置中实现了高达9.59%的精度改进和25.45%的忘记率降低.
- 通过平衡新旧类样本,有效地缓解了灾难性遗忘.
结论:
- MGBCIL为CIL的灾难性遗忘提供了一个有效的解决方案.
- 多细分平衡策略提高了学习稳定性和绩效.
- 这种方法对现实世界的增量学习应用有很大的前景.
更多相关视频
09:07Genetic Manipulation of Cerebellar Granule Neurons In Vitro and In Vivo to Study Neuronal Morphology and Migration
Published on: March 17, 2014
13.7K
11:38Author Spotlight: Enhancing PSC-to-Functional Cell Differentiation Using ML Models Based on Live-Cell Bright-Field Imaging
Published on: October 4, 2024
457
相关概念视频
Aggregates Classification
297
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
297
Associative Learning
273
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
273
Types of Aggregate Grading
376
Aggregate grading is crucial in economically obtaining a concrete mix with adequate strength, reasonable workability, and minimal segregation. There are four types of aggregate gradation: well-graded, uniformly (or one-sized) graded, gap-graded, and open-graded.
Well-graded aggregates include a complete range of necessary size fractions that fit together to create a dense matrix with minimal voids, represented by a smooth, continuous gradation curve. This type of grading ensures good...
Well-graded aggregates include a complete range of necessary size fractions that fit together to create a dense matrix with minimal voids, represented by a smooth, continuous gradation curve. This type of grading ensures good...
376
Multi-input and Multi-variable systems
93
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
93
End Point Prediction: Gran Plot
218
A Gran plot is used to predict the equivalence volume or endpoint of a potentiometric or acid-base titration without reaching the endpoint. Typically, titration data is collected as a function of the titrant's volume up to a point less than the equivalence volume and then transformed into a linear format. The straight line is extended to the x-axis, indicating the necessary titrant volume to achieve the equivalence point.
For potentiometric titration, the Gran plot is created by plotting...
For potentiometric titration, the Gran plot is created by plotting...
218
Design Example: Aggregate Gradation
85
The right type and quality of aggregates are crucial for concrete as they significantly influence its properties, mix proportions, and cost-effectiveness. If different sources are available for sand, the commonly used fine aggregate in concrete, the selection of sand is primarily based on its gradation.
The grading, or particle-size distribution, of sand is determined using sieve analysis, with standard sizes ranging from 150 μm to 10 mm (ASTM No. 100 sieve to 3⁄8 in. sieve). Sand is...
The grading, or particle-size distribution, of sand is determined using sieve analysis, with standard sizes ranging from 150 μm to 10 mm (ASTM No. 100 sieve to 3⁄8 in. sieve). Sand is...
85
