Does phasic dopamine release cause policy updates?

Area of Science:

• Neuroscience
• Behavioral Neuroscience
• Computational Neuroscience

Background:

• Phasic dopamine activity is hypothesized to encode reward-prediction errors (RPEs) and drive learning.
• This suggests that optogenetic dopamine stimulation should lead to continuously increasing work rates as RPEs are repeatedly signaled.

Purpose of the Study:

• To challenge the view that dopamine solely encodes RPEs by examining rat behavior during optogenetic stimulation.
• To investigate whether dopamine transients function as rewards or RPEs and explore the long-term effects of dopamine stimulation on behavior.

Main Methods:

• Rats performed tasks for optogenetic stimulation of midbrain dopamine neurons.
• Behavioral work rates were measured during stable and variable dopamine stimulation conditions.
• Reinforcement learning simulations were used for comparison.

Main Results:

• Rats exhibited stable, non-maximal work rates during repeated optogenetic dopamine stimulation within trials.
• Rats learned to distinguish between states based on dopamine activation history.
• Dopamine transients appeared to function as rewards rather than RPEs.
• A gradual increase in the pursuit of dopaminergic stimulation was observed over days/weeks.

Conclusions:

• The findings challenge the traditional RPE-encoding role of phasic dopamine.
• Dopamine transients may act as rewards, but their long-term effects suggest a more complex role.
• Multiple functions of dopamine signaling in reinforcement learning and motivation are considered.