Rostrolateral prefrontal cortex and individual differences in uncertainty-driven exploration.

Area of Science:

• Cognitive Neuroscience
• Decision Making
• Reinforcement Learning

Background:

• Individuals often face choices between a known reward and an uncertain option with potentially higher payoff.
• Strategic exploration, driven by uncertainty about option values, is crucial for optimal decision-making.
• The neural underpinnings of uncertainty-driven exploration are not fully understood.

Purpose of the Study:

• To investigate the neural mechanisms of uncertainty-driven exploration during a reinforcement learning task.
• To identify brain regions involved in tracking relative uncertainty and guiding exploratory behavior.

Main Methods:

• Functional magnetic resonance imaging (fMRI) was used to scan participants during a task involving stopping a clock hand for points.
• Mathematical models were fitted to behavioral data to estimate trial-by-trial exploration based on relative uncertainty.
• fMRI data were analyzed using these uncertainty estimates.

Main Results:

• The rostrolateral prefrontal cortex (rlPFC) showed activity that tracked trial-by-trial changes in relative uncertainty.
• This rlPFC activity pattern differentiated individuals based on their reliance on relative uncertainty for exploration.

Conclusions:

• The rostrolateral prefrontal cortex plays a key role in processing relative uncertainty to guide exploration.
• Individual differences in rlPFC function may explain variations in exploratory decision-making strategies.