Cortical substrates for exploratory decisions in humans.

Area of Science:

• Neuroscience
• Cognitive Science
• Decision Science

Background:

• Decision-making under uncertainty involves balancing information gathering (exploration) and utilizing existing knowledge (exploitation).
• While neural substrates for exploitation are known, those for exploration remain less understood.
• Reinforcement learning theory provides computational frameworks for understanding these processes.

Purpose of the Study:

• To identify the neural correlates of exploratory and exploitative decision-making in humans.
• To characterize the brain systems supporting the exploration-exploitation dilemma.
• To propose a computational model of action selection under uncertainty.

Main Methods:

• Human subjects performed a gambling task to elicit exploration-exploitation choices.
• Computational modeling characterized subject strategies for the dilemma.
• Functional magnetic resonance imaging (fMRI) identified brain activity patterns associated with exploratory and exploitative decisions.

Main Results:

• Frontopolar cortex and intraparietal sulcus showed preferential activation during exploratory decisions.
• Striatum and ventromedial prefrontal cortex were active during exploitative, value-based decisions.
• Decision-making was modeled as switching between distinct behavioral modes.

Conclusions:

• Distinct neural circuits support exploratory and exploitative decision-making modes.
• The frontopolar cortex and intraparietal sulcus are key for exploration.
• The striatum and ventromedial prefrontal cortex are crucial for exploitation, aligning with reinforcement learning models.