Related Experiment Video
Updated: Jul 17, 2025

06:57
Pavlovian Conditioned Approach Training in Rats
Published on: February 4, 2016
11.0K
Reward prediction error in learning-related behaviors
Yujun Deng1, Da Song1, Junjun Ni1
1Key Laboratory of Molecular Medicine and Biotherapy, School of Life Science, Beijing Institute of Technology, Beijing, China.
Frontiers in Neuroscience
|September 4, 2023
Summary
Unexpected information changes our decisions, but how the brain revises learning is unclear. This review explores reward prediction error, its neural basis, and role in behaviors and diseases like Parkinson's.
Area of Science:
- Neuroscience
- Cognitive Science
- Learning and Memory
Background:
- Learning involves adapting to new information, but the underlying neural mechanisms for revision are not fully understood.
- Prediction error has long been considered central to learning and decision-making.
- The specific role of reward prediction error in neural plasticity and behavior requires further elucidation.
Purpose of the Study:
- To review the concept of reward prediction error (RPE).
- To explore the neural encoding mechanisms of RPE, focusing on dopaminergic neurons and circuits.
- To discuss the implications of RPE in learning-related behaviors and neurological disorders.
Main Methods:
- Literature review of studies on reward prediction error.
- Analysis of neurobiological mechanisms, including dopaminergic pathways.
- Examination of behavioral and clinical evidence linking RPE to learning and disease.
Main Results:
- Reward prediction error is a key signal driving learning and behavioral adaptation.
- Dopaminergic neurons play a critical role in encoding RPE signals.
- RPE signals are implicated in various learning behaviors, such as reversal learning, and are altered in neurological conditions.
Conclusions:
- Reward prediction error is fundamental to adaptive learning and decision-making.
- Understanding RPE neural circuits offers insights into learning processes.
- Dysregulation of RPE is associated with neurological diseases, suggesting therapeutic targets.
Related Concept Videos
Timing and Consequences on Behavior
119
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
119
Purposive Learning
140
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
140
Behaviorism
2.3K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
2.3K
Hindsight Biases
3.4K
Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now?
3.4K
Law of Effect
1.4K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.4K
Punishment
225
Negative reinforcement and punishment are often confused but serve distinct functions in behavior modification. Reinforcement, whether positive or negative, increases the likelihood of a desired behavior, while punishment decreases it.
Punishment can be positive or negative. Positive punishment involves adding an undesirable stimulus, such as scolding, to decrease a behavior. Negative punishment involves removing a desirable stimulus, such as taking away a favorite toy, to decrease behavior....
Punishment can be positive or negative. Positive punishment involves adding an undesirable stimulus, such as scolding, to decrease a behavior. Negative punishment involves removing a desirable stimulus, such as taking away a favorite toy, to decrease behavior....
225

