Related Experiment Video
Updated: Apr 6, 2026
06:57
Pavlovian Conditioned Approach Training in Rats
Published on: February 4, 2016
11.7K
Principal components analysis of reward prediction errors in a reinforcement learning task
Thomas D Sambrook1, Jeremy Goslin1
1Cognition Institute, Department of Psychology, Plymouth University, Plymouth PL4 8AA, UK.
Neuroimage
|July 22, 2015
Summary
The feedback-related negativity (FRN) brain signal may encode positive reward prediction errors (RPEs) but not negative RPEs. This finding clarifies the neural basis of reinforcement learning and decision-making processes.
Area of Science:
- Neuroscience
- Cognitive Science
- Computational Neuroscience
Background:
- Reinforcement learning models use reward prediction errors (RPEs) to represent outcomes.
- The feedback-related negativity (FRN) is an electrophysiological signal linked to RPEs.
- It remains unclear if the FRN is sensitive to both positive and negative RPE magnitudes.
Purpose of the Study:
- To investigate whether the FRN is sensitive to the magnitude of both positive and negative reward prediction errors.
- To differentiate RPE encoding from unsigned prediction error (salience) signals.
Main Methods:
- Parametrically modulated positive and negative RPEs using reward likelihood and magnitude.
- Applied principal components analysis to electrophysiological data to isolate neural components.
- Analyzed event-related potentials time-locked to feedback stimuli.
Main Results:
- Identified a single component sensitive to the magnitude of positive RPEs, peaking around 330ms in the delta frequency band.
- Demonstrated components responsive to unsigned prediction error size (salience).
- Found no evidence for a component specifically sensitive to the magnitude of negative RPEs.
Conclusions:
- The FRN or a closely related component appears to encode the magnitude of positive RPEs.
- The neural basis for encoding negative RPE magnitude remains elusive.
- Findings contribute to understanding the neural mechanisms of reinforcement learning and decision-making.
Related Concept Videos
01:23Reinforcement
1.2K
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
1.2K
01:09Decision Making: P-value Method
7.3K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
7.3K
01:23Primary and Secondary Reinforcers
1.6K
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
1.6K
01:12Observational Learning
1.2K
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
1.2K
01:08Timing and Consequences on Behavior
708
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
708
01:24Reinforcement Schedules
697
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
697