Policy Complexity Suppresses Dopamine Responses.

Area of Science:

• Neuroscience
• Cognitive Science
• Computational Biology

Background:

• Information processing capacity is a fundamental constraint on task performance.
• Understanding how the brain optimizes behavior within these limits is crucial.

Purpose of the Study:

• To investigate how animals achieve near-optimal performance on perceptual decision tasks despite capacity limitations.
• To explore the role of policy complexity and reinforcement learning mechanisms in shaping behavior.

Main Methods:

• Measured policy complexity (mutual information between states and actions) in male and female mice during a perceptual decision task.
• Investigated the potential role of reinforcement learning with policy complexity penalties.
• Examined midbrain dopamine responses to reward outcomes and their relation to policy complexity.
• Correlated neural and behavioral reward sensitivity.

Main Results:

• Mice achieved near-optimal performance relative to their information processing capacity limits.
• Policy complexity was found to suppress midbrain dopamine responses to reward outcomes.
• Neural and behavioral reward sensitivity showed a positive correlation across sessions.

Conclusions:

• Policy compression, a strategy to simplify decision-making, appears to shape fundamental mechanisms of reinforcement learning in the brain.
• Dopaminergic signals may play a role in implementing policy complexity penalties during learning.