Related Experiment Video
Updated: May 22, 2026

06:11
A Conflict Model of Reward-seeking Behavior in Male Rats
Published on: February 20, 2019
Go and no-go learning in reward and punishment: interactions between affect and effect
Marc Guitart-Masip1, Quentin J M Huys, Lluis Fuentemilla
1Institute of Cognitive Neuroscience, University College London, London, W1CN 4AR, UK. m.guitart@ucl.ac.uk
Neuroimage
|May 3, 2012
Summary
Learning to make choices involves balancing rewards and punishments. This study reveals that instrumental learning, essential for decision-making, depends on overcoming innate biases and engaging specific brain regions for action and inhibition.
Area of Science:
- Neuroscience
- Cognitive Science
- Decision Science
Background:
- Decision-making is governed by affect (valence) and effect (action).
- Understanding how humans learn instrumental actions under different outcome valences is crucial.
- Existing models often struggle to disentangle instrumental and Pavlovian influences.
Purpose of the Study:
- To investigate the acquisition of instrumental responding when action requirements and outcome valence are orthogonalized.
- To differentiate instrumental and Pavlovian contributions to learning asymmetries.
- To identify neural correlates of instrumental learning using model-based fMRI.
Main Methods:
- Behavioral experiments with healthy volunteers using a task with orthogonalized action and valence.
- Computational reinforcement-learning models to analyze learning components.
- Model-based functional Magnetic Resonance Imaging (fMRI) to examine brain activity.
Main Results:
- Subjects learned active choices better in rewarded conditions and passive choices in punished conditions.
- Computational models revealed instrumental learning is modulated by Pavlovian biases.
- BOLD signals in the striatum and substantia nigra/ventral tegmental area (SN/VTA) correlated with action values.
- Successful instrumental learning engaged the bilateral inferior frontal gyrus.
Conclusions:
- Instrumental learning is contingent on overcoming inherent and plastic Pavlovian biases.
- Neural activity in the striatum, SN/VTA, and inferior frontal gyrus underpins instrumental learning.
- This learning involves distinct brain activity patterns related to action and inhibition.
Related Concept Videos
Law of Effect
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Operant Conditioning
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Behaviorism
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
Cognitive Learning
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
Punishment
Negative reinforcement and punishment are often confused but serve distinct functions in behavior modification. Reinforcement, whether positive or negative, increases the likelihood of a desired behavior, while punishment decreases it.
Punishment can be positive or negative. Positive punishment involves adding an undesirable stimulus, such as scolding, to decrease a behavior. Negative punishment involves removing a desirable stimulus, such as taking away a favorite toy, to decrease behavior.
Punishment can be positive or negative. Positive punishment involves adding an undesirable stimulus, such as scolding, to decrease a behavior. Negative punishment involves removing a desirable stimulus, such as taking away a favorite toy, to decrease behavior.

