相关实验视频
Updated: Jun 13, 2025

06:57
Pavlovian Conditioned Approach Training in Rats
Published on: February 4, 2016
10.9K
潜在的偶然性解释了协会学习期间的行为和多巴胺信号
Lechen Qian1,2, Mark Burrell1,2, Jay A Hennig2,3
1Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA, USA.
Nature neuroscience
|March 19, 2025
概括
关联式学习依赖于刺激结果预测. 对于这种学习至关重要的小鼠的多巴胺信号通过奖励时间调节,支持时间差异学习模型.
科学领域:
- 神经科学是一个神经科学.
- 计算神经科学是一种神经科学.
- 行为科学 行为科学
背景情况:
- 关联式学习是行为的基础.
- 刺激-结果偶然性如何影响行为的神经基础尚未完全理解.
- 腹状条纹体中的多巴胺信号与关联性学习有关.
研究的目的:
- 调查协会学习中的偶然性的神经机制.
- 在小鼠的帕夫洛夫式应急降解任务期间,检查腹部条纹体中的多巴胺活性.
- 评估解释观察到的多巴胺反应的计算模型.
主要方法:
- 小鼠接受了帕夫洛夫式的应急降解任务.
- 预期的行为被记录下来.
- 测量了腹腔条纹体中的多巴胺活性.
- 计算模型,包括时间差异 (TD) 学习,用于解释结果.
主要成果:
- 预期和多巴胺对有条件刺激的反应在未煮熟的奖励下降.
- 如果提供额外的奖励,这些反应保持不变.
- 结果与传统的应急账户和因果学习模型 (ANCCR) 相矛盾.
- 具有试验间隔状态表示的时间差异 (TD) 学习模型解释了这些发现.
结论:
- 腹状条纹体中的多巴胺活性反映了关联性学习中的时间差异错误.
- TD学习模型提供了一个框架,以了解意外情况如何影响多巴胺信号和行为.
- 在TD框架内的反复的神经网络可以开发出相关的状态表示.
相关概念视频
Associative Learning
313
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
313
Timing and Consequences on Behavior
84
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
84
Behaviorism
2.3K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
2.3K
Operant Conditioning
1.6K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
1.6K
Real-World Application of Classical Conditioning
537
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
537
Generalization, Discrimination, and Extinction
481
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
481

