Related Experiment Video
Updated: Jun 3, 2026

06:57
Pavlovian Conditioned Approach Training in Rats
Published on: February 4, 2016
Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis
1Center for Neuroeconomics, New York University, New York, NY 10003, USA. glimcher@cns.nyu.edu
Summary
Recent advances reveal that midbrain dopamine neuron activity globally modifies synapses, underpinning reinforcement learning in behavior. This review integrates empirical findings and computational models to explain this critical link.
Area of Science:
- Neuroscience
- Computational Neuroscience
- Behavioral Science
Background:
- Midbrain dopaminergic neurons play a crucial role in various brain functions.
- Understanding their activity is key to deciphering complex behaviors.
- Computational models are essential for interpreting experimental data.
Purpose of the Study:
- To review recent advances in midbrain dopaminergic neuron research.
- To explain the role of these neurons in synaptic modification and reinforcement learning.
- To integrate theoretical and empirical findings in this field.
Main Methods:
- Review of empirical findings on midbrain dopamine neuron activity.
- Analysis of computational models explaining neuronal function.
- Synthesis of theoretical frameworks and experimental evidence.
Main Results:
- Phasic activity of midbrain dopamine neurons acts as a global synaptic modification mechanism.
- Synaptic modifications driven by dopamine neurons provide the basis for reinforcement learning.
- This mechanism underlies a significant portion of human and animal behavior.
Conclusions:
- The phasic activity of midbrain dopamine neurons is a fundamental mechanism for learning.
- Integration of computational and experimental approaches has clarified this role.
- This understanding provides a framework for future research into behavior and neurological disorders.
Related Concept Videos
Law of Effect
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Reinforcement
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Generalization, Discrimination, and Extinction
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Operant Conditioning
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...

