Related Experiment Video
Updated: Jul 15, 2026

08:30
Operant Procedures for Assessing Behavioral Flexibility in Rats
Published on: February 15, 2015
Orbitofrontal noradrenaline supports adaptive learning-rate adjustment in probabilistic reversal learning
Hadrien Plat1, Coline Chevallier2, Alessandro Piccin1
1University of Bordeaux, Institut de Neurosciences Cognitives et Intégratives d'Aquitaine, UMR 5287 CNRS, Bordeaux 33000, France.
Summary
Rats adjust their learning speed based on environmental volatility, a process mediated by noradrenergic signals from the locus coeruleus to the orbitofrontal cortex, crucial for adaptive decision-making.
Area of Science:
- Neuroscience
- Computational Psychiatry
- Behavioral Economics
Background:
- Adaptive decision-making hinges on flexible learning rates, balancing stability against volatility.
- Internal uncertainty estimates are theorized to modulate learning via neuromodulation.
- The locus coeruleus (LC) and orbitofrontal cortex (OFC) are implicated in learning and decision-making under uncertainty.
Purpose of the Study:
- Investigate the role of noradrenergic inputs from the LC to the OFC in adaptive learning under uncertainty.
- Determine how internal volatility estimates influence learning rate adjustments.
- Identify the neural mechanisms underlying flexible learning in dynamic environments.
Main Methods:
- Utilized a probabilistic reversal learning task in rats across varying stochasticity levels.
- Employed an adaptive reinforcement-learning model to analyze behavioral data and estimate volatility.
- Measured noradrenaline release in the OFC and experimentally disrupted LC→OFC noradrenergic inputs.
Main Results:
- Rat behavior aligned with an adaptive model where learning rates dynamically adjusted to estimated stochasticity and volatility.
- OFC noradrenaline release correlated with model-derived volatility estimates during environmental changes.
- Disruption of LC→OFC noradrenergic signaling impaired adaptive learning-rate adjustment.
Conclusions:
- OFC noradrenergic signaling is a critical neural mechanism for adjusting learning rates based on volatility.
- This pathway supports adaptive decision-making by integrating internal volatility estimates.
- Findings elucidate a key circuit for flexible learning in dynamic, uncertain environments.
Related Concept Videos
Associative Learning
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
Avoidance Learning and Learned Helplessness
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Observational Learning
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...
Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Instinctive Drift
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
