Related Experiment Video
Updated: Jun 6, 2026
08:30
Operant Procedures for Assessing Behavioral Flexibility in Rats
Published on: February 15, 2015
Beyond reversal: a critical role for human orbitofrontal cortex in flexible learning from probabilistic feedback
Ami Tsuchida1, Bradley B Doll, Lesley K Fellows
1Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada. ami.tsuchida@mail.mcgill.ca
Summary
Damage to the orbitofrontal cortex (OFC) impairs flexible learning in changing environments. This brain region is crucial for interpreting feedback and adapting behavior, unlike other frontal areas.
Area of Science:
- Neuroscience
- Cognitive Psychology
- Behavioral Science
Background:
- Orbitofrontal cortex (OFC) damage is associated with poor reinforcement processing and maladaptive behaviors in dynamic environments.
- Flexible stimulus-outcome learning, essential for adapting to changing conditions, critically depends on the OFC in various species.
- The exact function of the OFC in this learning and the involvement of other frontal regions remain unclear in humans.
Purpose of the Study:
- To investigate the specific role of the orbitofrontal cortex (OFC) in flexible stimulus-reinforcement learning in humans.
- To determine if other prefrontal regions also contribute to this type of learning.
- To elucidate the mechanisms by which OFC damage affects learning in dynamic environments.
Main Methods:
- Administered a probabilistic reversal learning task to 39 patients with frontal lobe lesions and 51 healthy controls.
- Utilized voxel-based lesion-symptom mapping to pinpoint critical frontal lobe regions for task performance.
- Analyzed learning performance both overall and on a trial-by-trial basis.
Main Results:
- OFC damage significantly disrupted both initial and reversal learning in a probabilistic feedback environment.
- Trial-by-trial analysis indicated OFC's role in contextualizing feedback based on outcome history, not just inhibiting associations.
- Voxel-based lesion-symptom mapping identified the OFC as critical, with no significant contribution from other prefrontal regions.
Conclusions:
- The orbitofrontal cortex (OFC) plays a necessary role in human flexible stimulus-reinforcement learning.
- OFC is essential for interpreting trial feedback within the context of past outcomes.
- Findings differentiate the OFC's function from other prefrontal areas in adaptive learning.
Related Concept Videos
01:12Observational Learning
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...
01:21Cognitive Learning
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
01:14Avoidance Learning and Learned Helplessness
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
01:27Associative Learning
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
01:21Operant Conditioning
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
01:22Purposive Learning
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a bonus...