多巴胺和学习:中脑是用惊喜来教的还是有价值的?
Robin Piquet1, Yacine Tensaouti2, Shauna L Parkes3
1Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, UK; These authors contributed equally.
Current biology : CB
|August 19, 2025
概括
多巴胺是一种多巴胺.
科学领域:
- 神经科学是一个神经科学.
- 行为科学 行为科学
- 计算神经科学是一种神经科学.
背景情况:
- 多巴胺是一种神经递质,与奖励和学习有关.
- 它在形成刺激与结果之间的关联方面的确切作用仍在争论中.
- 以前的研究表明,多巴胺可能会信号奖励值或预测错误.
研究的目的:
- 阐明多巴胺在关联性学习中的特定功能.
- 区分多巴胺在信号奖励价值中的作用与奖励预测错误之间的区别.
- 了解强化学习背后的神经生物学机制.
主要方法:
- 利用计算建模来模拟学习过程.
- 采用神经成像技术在体内测量多巴胺信号.
- 设计行为实验来评估在不同奖励条件下学习的关联.
主要成果:
- 多巴胺信号强大预测了奖励预测错误的发生.
- 多巴胺水平的变化与奖励的感知价值没有直接相关.
- 该研究证实了多巴胺在更新行动结果预期方面的关键作用.
结论:
- 多巴胺在学习中的主要功能是信号预期和实际奖励之间的差异 (奖励预测错误).
- 这种奖励预测错误信号驱动了学习协会的调整.
- 这些发现澄清了多巴胺在强化学习中的机制,与奖励估值不同.
相关概念视频
Purposive Learning
206
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
206
Behaviorism
2.7K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
2.7K
Cognitive Learning
517
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
517
Law of Effect
1.6K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.6K
Operant Conditioning
1.8K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
1.8K
Timing and Consequences on Behavior
152
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
152


