通过特定任务的提示-原型的关键-值无对连续学习者
Haihua Luo1, Xuming Ran2, Zhengji Li3
1University of Jyväskylä, Faculty of Information and Technology, Finland; Dalian University of Technology, School of Computer Science and Technology, China.
概括
本研究引入了一种新的持续学习方法,使用特定任务的Prompt-Prototypes (ProP) 来避免键值对. 这种方法可以增强知识的获取和保留,而不会造成任务间的干扰,从而提高模型的可扩展性.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算机科学 计算机科学
背景情况:
- 持续学习使模型能够连续学习而不会忘记.
- 基于提示符的方法是有效的,但由于关键-值配对而遭受任务间干扰和可扩展性问题.
研究的目的:
- 提出一种新的基于提示的持续学习方法,可以消除关键-值对的依赖.
- 在持续学习场景中增强特征学习和模型稳定性.
主要方法:
- 引入了特定任务的快速原型 (ProP),以取代关键-值对.
- 用于有效的当前任务特征学习的提示,以及用于代表性特征捕获的原型.
- 在快速初始化过程中实施规范化约束,以提高稳定性.
主要成果:
- 拟议的ProP方法在多个数据集中表现出有效性.
- 消除了对关键-值对的需求,解决了现有的基于提示的方法的局限性.
- 在持续学习任务中表现出更好的表现.
结论:
- ProP框架为基于提示的持续学习提供了一个可扩展和稳定的替代方案.
- 这种新的方法通过消除关键-价值依赖,为未来的持续学习研究提供了新的方向.
相关概念视频
Purposive Learning
447
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
447
Cognitive Learning
1.0K
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
1.0K
Elaborative Rehearsals
338
Elaborative rehearsal is a crucial cognitive strategy that strengthens information encoding in long-term memory by making meaningful connections between new data and pre-existing knowledge. This approach contrasts with maintenance rehearsal, which involves simple repetition without delving into the significance of the information. While maintenance rehearsal might temporarily keep information active in short-term memory, it is less effective for long-term retention.
The effectiveness of...
The effectiveness of...
338
Associative Learning
1.3K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.3K
Operant Conditioning Intervention
461
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...
461
Concepts and Prototypes
511
The human nervous system handles vast amounts of information by translating sensory stimuli into neural impulses, which the brain processes, creating thoughts expressed through language or stored as memories. The brain also synthesizes information from emotions and memories, which significantly influence thoughts and behaviors. This intricate process creates a comprehensive mental picture.
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
511


