PASS++:一个双偏差减少框架,用于非模范类增量学习
概括
本研究引入了一种双偏减框架,用于阶级增量学习 (CIL),避免存储旧数据. 该方法通过改进数据表示和分类器偏差来有效地减少遗忘,实现与数据依赖方法相比的性能.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算机视觉 计算机视觉
背景情况:
- 阶级增量学习 (CIL) 使模型能够连续学习新类.
- 现有的CIL方法通常依赖于存储旧数据 (样本),当数据不可用时,导致灾难性遗忘.
- 灾难性遗忘源于CIL模型中的表示和分类器偏差.
研究的目的:
- 提出一个新的非典范类增量学习框架.
- 为了解决CIL固有的表示和分类器偏见.
- 开发一种在不存储旧数据的情况下减轻遗忘的方法.
主要方法:
- 一个双偏减框架,结合了自我监督转换 (SST) 和原型增强 (protoAug).
- 通过学习多样化,任务不可知的特征,SST增强了表示的概括性.
- protoAug在功能空间中加强了旧的类原型,以保持决策边界.
主要成果:
- 拟议的框架大大减少了CIL的遗忘.
- 性能与最新的以示例为基础的方法相比,尽管不存储旧数据.
- 该方法与预先训练的模型无集成.
结论:
- 重新考虑存储旧样本的必要性对于推进非典范性CIL至关重要.
- 双偏减框架为数据效率高的CIL提供了有效的解决方案.
- 这项工作鼓励进一步研究无样本CIL方法.
相关概念视频
Observational Learning
106
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
106
Associative Learning
255
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
255
Multi-input and Multi-variable systems
91
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
91
Generalization, Discrimination, and Extinction
355
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
355
Improving Translational Accuracy
2.5K
2.5K
Purposive Learning
95
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
95


