课堂增量学习的反复扩展网络
IEEE transactions on neural networks and learning systems
|August 27, 2025
概括
通过连接任务专家,减少参数和改进适应视觉智能的功能利用,反复扩展网络 (RNE) 增强了类增量学习 (CIL).
科学领域:
- 计算机视觉
- 机器学习
- 人工智能
背景情况:
- 阶级增量学习 (CIL) 对于适应性视觉智能至关重要.
- 目前的网络扩展 (NE) 方法面临诸如特征扩散,参数增长,特征混和分类器偏差等挑战.
研究的目的:
- 引入一个新的动态结构,即循环网络扩展 (RNE),以解决现有的CIL方法的局限性.
- 改进功能利用,减少CIL中的模型复杂性.
主要方法:
- 拟议的RNE通过共享模块在任务专家之间建立了连续的特征传递.
- 新的任务专家根据收到的特征进行调整,防止扩散并专注于关键领域.
- RNE采用压缩方式,用简化版本取代任务专家,并使用带有伪特征生成的脱分类器来减轻混和偏差.
主要成果:
- 在保持性能的同时,RNE显著降低了参数.
- 这种方法有效地减轻了特征混,并纠正了分类器偏差.
- 在CIFAR-100,ImageNet-100,Food-101和ImageNet-1K数据集上实现了最先进的 (SOTA) 性能.
结论:
- 通过提高特征处理和模型效率,RNE为课堂增量学习提供了有效的解决方案.
- 拟议的方法在标准和具有挑战性的CIL场景中表现出卓越的表现.
相关概念视频
Associative Learning
569
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
569
Observational Learning
310
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
310
Generalization, Discrimination, and Extinction
784
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
784
Introduction to Learning
529
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
529
Cognitive Learning
516
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
516
Neuroplasticity
752
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
752
