Related Experiment Video
Updated: Jun 9, 2025

06:11
A Conflict Model of Reward-seeking Behavior in Male Rats
Published on: February 20, 2019
7.4K
Sequence termination cues drive habits via dopamine-mediated credit assignment
Robin Magnard1, Yifeng Cheng1,2, Joanna Zhou1
1Department of Psychological and Brain Sciences, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD.
Biorxiv : the Preprint Server for Biology
|October 28, 2024
Summary
Sequence termination cues, not initiation cues, drive habit formation by altering dopamine signals. This suggests dopamine
Area of Science:
- Neuroscience
- Behavioral Science
- Learning and Memory
Background:
- Mesolimbic dopamine (DA) neurons are crucial for sequence learning and habit formation.
- The precise mechanisms by which cue-induced DA activity influences goal-directed versus habitual sequence execution are not fully understood.
Purpose of the Study:
- To investigate how sequence initiation and termination cues impact DA-driven behavioral strategies and learning.
- To elucidate the neural mechanisms underlying the development of habitual action sequences.
Main Methods:
- Development and utilization of two novel behavioral tasks.
- Mesolimbic fiber photometry recordings to monitor DA neural activity.
- Optogenetic stimulation of ventral tegmental area (VTA) DA neurons.
Main Results:
- Sequence termination cues, but not initiation cues, promoted outcome devaluation insensitivity, automaticity, and behavioral chunking, indicative of habit formation.
- Habit-like behavior correlated with backpropagating DA signals and reduced DA reward prediction errors.
- Optogenetic stimulation at sequence termination induced automaticity and chunking, even without external cues.
Conclusions:
- Cue-evoked DA signals at sequence termination are critical for mediating credit assignment.
- These DA signals drive the development of habitual action sequence execution.
- Findings illuminate the role of specific DA signaling patterns in behavioral flexibility and automaticity.
Related Concept Videos
Timing and Consequences on Behavior
82
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
82
Instinctive Drift
193
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
193
Drug Abuse and Addiction: Pharmacological Phenomena
445
Drug dependence, abuse, and addiction are complex phenomena that can precipitate various abnormal states. Physical dependence refers to a state of pharmacological adaptation to a drug. This adaptation often results in tolerance—a reduced response to the drug after repeated administrations. When the drug use is abruptly stopped, withdrawal symptoms occur due to the body's need to readjust from the pharmacologically induced imbalance. However, tolerance and withdrawal symptoms do not...
445
Operant Conditioning
1.5K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
1.5K
Reinforcement Schedules
133
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
133
Operant Conditioning Intervention
44
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...
44

