Related Experiment Video
Updated: Mar 24, 2026

08:30
Operant Procedures for Assessing Behavioral Flexibility in Rats
Published on: February 15, 2015
21.7K
Orbitofrontal cortex reflects changes in response-outcome contingencies during probabilistic reversal learning
L R Amodeo1, M S McMurray2, J D Roitman3
1Department of Psychology, University of Illinois at Chicago, 1007 West Harrison Street, Chicago, IL 60607, USA.
Neuroscience
|March 22, 2016
Summary
Animals adapt behavior by learning from feedback. The orbitofrontal cortex (OFC) plays a key role in flexible behavior, with OFC neuron activity changing to reflect reward outcomes during learning and reversal tasks.
Area of Science:
- Neuroscience
- Behavioral Neuroscience
- Cognitive Neuroscience
Background:
- Flexible behavior is crucial for adapting to changing environments.
- The orbitofrontal cortex (OFC) is implicated in behavioral flexibility and reward-based decision-making.
Purpose of the Study:
- To investigate the neural basis of behavioral flexibility in the OFC using a probabilistic reversal learning task in rats.
- To examine how OFC neuronal activity changes during the acquisition and reversal of reward-based choices.
Main Methods:
- Rats performed a probabilistic reversal learning task with changing reward contingencies.
- Single-unit activity of OFC neurons was recorded throughout the task.
- Principal component analysis was used to analyze population-level neural activity patterns.
Main Results:
- Rats successfully acquired and reversed lever choices, though reversal learning required more sessions.
- OFC neuronal activity was modulated by reward outcomes, generally increasing after rewarded choices.
- A decrease in OFC responses to reward following incorrect choices correlated with the establishment of new preferences.
Conclusions:
- OFC neuronal signaling is involved in adapting behavior to changing reward contingencies.
- The findings highlight the role of OFC in flexible, goal-directed behavior under uncertainty.
Keywords:
cognitive flexibilityelectrophysiologyorbitofrontal cortexprobabilistic reversal learningrewardMore Related Videos
Related Concept Videos
Operant Conditioning
3.3K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
3.3K
Timing and Consequences on Behavior
632
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
632
Law of Effect
5.4K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
5.4K
Operant Conditioning Intervention
628
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...
628
Real-World Application of Classical Conditioning
2.1K
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
2.1K
Associative Learning
1.8K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.8K

