多任务学习的课程效应通过情境推理的透视来学习
Sabyasachi Shivkumar1, Máté Lengyel2, Daniel M Wolpert3
1Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Kavli Institute for Brain Science, Columbia University, New York, USA.
Current opinion in neurobiology
|October 10, 2025
概括
实践结构显著影响跨运动,规则,感知和机器学习任务的学习. 语境推理提供了一个统一的框架来解释学习速度和记忆之间的权衡,可能减轻人工智能的灾难性遗忘.
科学领域:
- 认知科学 认知科学
- 机器学习 机器学习
- 神经科学是一个神经科学.
背景情况:
- 实践或课程的结构对于多任务学习结果至关重要.
- 在快速学习和在多任务设置中长期保留之间经常存在权衡.
- 阻塞训练可以增强获取,但减少保留 (例如,运动学习),而间接训练可以提高保留,但缓慢获取.
研究的目的:
- 提出一个统一的框架,上下文推理,解释实践结构在不同领域对学习的不同影响.
- 调查任务转换动态,上下文线索和观察噪声如何影响学习成果.
- 探索生物学习原理如何为机器学习提供信息,以减轻灾难性干扰.
主要方法:
- 该研究提出了一个理论框架,上下文推断,整合任务过渡动态,上下文线索和观察噪音.
- 它在运动学习,感知学习,认知学习和机器学习 (灾难性遗忘) 的发现之间进行了平行.
- 该框架旨在解释为什么阻塞培训有利于某些学习类型,而损害其他类型.
主要成果:
- 阻塞训练可以导致更快的获取,但在诸如运动学习等领域的长期保留率较低.
- 感知和认知学习往往受益于结构化,封闭的培训课程.
- 机器学习表现出"灾难性遗忘",这种现象类似于阻塞运动学习中的记忆减少.
结论:
- 语境推理为实践结构对不同领域学习的影响提供了统一的解释.
- 了解这些原则可以启发方法,以减少机器学习的灾难性干扰.
- 利用生物学习的见解可以提高人工智能系统的稳定性和效率.
相关概念视频
01:22Purposive Learning
442
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
442
01:27Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
01:21Cognitive Learning
1.0K
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
1.0K
01:12Observational Learning
832
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
832
01:21Impact of Social Context on Individuals
278
Social psychology examines how the real or imagined presence of others influences individuals' thoughts, feelings, and behaviors. A key concept in this field is the role of social context in shaping behavior. The same individual may act differently depending on the social setting, due to the varying expectations and norms associated with each environment. This context-dependent behavior illustrates the influence of social roles, which prescribe appropriate conduct in specific situations.Social...
278
01:22Multi-input and Multi-variable systems
389
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
389