Related Experiment Video
Updated: Jul 9, 2025

09:13
A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents
Published on: May 3, 2012
14.4K
Nucleus accumbens dopamine release reflects Bayesian inference during instrumental learning.
Albert J Qü1,2, Lung-Hao Tai3, Christopher D Hall4
1Department of Psychology, University of California, Berkeley, CA, 94720, USA.
Biorxiv : the Preprint Server for Biology
|November 28, 2023
Summary
Mice use probabilistic beliefs to make decisions in a two-armed bandit task. Dopamine signals in the nucleus accumbens reflect these beliefs, supporting its role in reinforcement learning.
Area of Science:
- Neuroscience
- Computational Neuroscience
- Behavioral Neuroscience
Background:
- Dopamine release in the nucleus accumbens is theorized to signal reward prediction error, crucial for reinforcement learning.
- Understanding the brain's mapping of sensory information to reward predictions is vital, especially with ambiguous environmental cues.
Purpose of the Study:
- To investigate how probabilistic beliefs influence instrumental task performance and dopamine signaling.
- To test if dopamine release in the nucleus accumbens reflects Bayesian updating of beliefs about the environment's hidden state.
Main Methods:
- Mice performed a two-armed bandit task with a repeatedly switching hidden state.
- Choice behavior was recorded, alongside dopamine release in the nucleus accumbens core using dLight signals.
- Cognitive models were compared using behavioral data to identify the best-fitting belief computation strategy.
Main Results:
- Behavioral data strongly favored models employing Bayesian updating of probabilistic beliefs over non-Bayesian alternatives.
- The same Bayesian models provided a superior quantitative match to the recorded dopamine measurements.
- This indicates that probabilistic belief computation is integral to task performance and reflected in dopamine signaling.
Conclusions:
- Probabilistic belief computation plays a significant role in instrumental learning and decision-making in mice.
- Mesolimbic dopamine signaling in the nucleus accumbens appears to reflect these underlying probabilistic computations.
- The findings support a model where dopamine signals integrate belief updating for adaptive behavior.
Related Concept Videos
Associative Learning
404
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
404
Instinctive Drift
228
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
228

