Dynamics of striatal action selection and reinforcement learning.

Area of Science:

• Neuroscience
• Computational Neuroscience
• Systems Neuroscience

Background:

• Spiny projection neurons (SPNs) in the dorsal striatum are central to reinforcement learning models in the basal ganglia.
• Existing models face inconsistencies with known SPN synaptic plasticity rules.

Purpose of the Study:

• To resolve inconsistencies between striatal reinforcement learning models and SPN synaptic plasticity.
• To propose a revised model for learning and action selection in the basal ganglia.

Main Methods:

• Analysis of synaptic plasticity rules for direct-pathway (dSPN) and indirect-pathway (iSPN) neurons.
• Computational modeling of reinforcement learning incorporating SPN function.
• Validation using striatal recordings.

Main Results:

• iSPN plasticity, as currently modeled, hinders learning by reinforcing negative outcomes.
• Simultaneous activation of functionally opposing dSPNs and iSPNs by efferent input reverses this pathological effect.
• This resolves the conflict between striatal learning models and SPN plasticity.

Conclusions:

• A revised model allows for multiplexing of learning and action selection signals without interference.
• This framework supports learning algorithms beyond standard temporal difference models.
• The findings offer a more accurate representation of SPN function in reinforcement learning.