The neurocomputational bases of explore-exploit decision-making.

Area of Science:

• Neuroscience
• Cognitive Science
• Decision Science

Background:

• Flexible decision-making involves balancing exploitation (immediate rewards) and exploration (novel options).
• Understanding the neural basis of explore-exploit tradeoffs is crucial for cognitive flexibility.

Purpose of the Study:

• To investigate the conserved computational basis of explore-exploit tradeoffs in humans and monkeys.
• To identify human brain regions encoding reward value and uncertainty during flexible decisions using fMRI.

Main Methods:

• Utilized a partially observable Markov decision process (POMDP) model to quantify choice values.
• Employed functional magnetic resonance imaging (fMRI) to examine brain activity in human participants.
• Compared findings with prior neurophysiological data from monkey studies.

Main Results:

• Confirmed conserved computational mechanisms for explore-exploit tradeoffs across species.
• Identified divergent encoding of reward value and uncertainty in prefrontal and parietal cortices (e.g., frontopolar cortex).
• Observed parallel encoding of value and uncertainty in motivational circuits (amygdala, ventral striatum, orbitofrontal cortex).

Conclusions:

• Human and nonhuman primate brains share neural substrates for managing explore-exploit decisions.
• Prefrontal and parietal regions differentially process reward value and uncertainty.
• Motivational circuits integrate these computations to support adaptive decision-making.