Flexible control as surrogate reward or dynamic reward maximization

Area of Science:

• Cognitive Neuroscience
• Decision Science
• Behavioral Economics

Background:

• The value of experiences fluctuates based on homeostatic and hedonic principles.
• Maximizing reward necessitates adaptable behavior to changing preferences and outcomes.
• Flexible instrumental control, defined information-theoretically, is a potential reward surrogate or a mechanism for planning dynamic value changes.

Purpose of the Study:

• To investigate whether planning for dynamic changes in outcome values underlies adaptable, flexible control.
• To compare an expected utility model with other frameworks for explaining choice behavior under changing values.
• To explore the relationship between individual differences in schizotypy and flexible control.

Main Methods:

• Developed an expected utility model incorporating monetary gains and losses associated with sensory outcomes.
• Collected behavioral choice data to evaluate model fit and earned rewards.
• Assessed individual differences in dimensional schizotypy.

Main Results:

• The expected utility model provided the best fit to behavioral choice data and maximized earned rewards.
• Behavioral choices aligned with predictions of planning for dynamic changes in outcome values.
• Dimensional schizotypy correlated with behavioral preferences, particularly in conditions demanding high or low flexible control.

Conclusions:

• Adaptability in goal-directed choice may be implemented by planning for dynamic changes in outcome values.
• The expected utility model effectively captures flexible instrumental control and its role in maximizing rewards.
• Individual differences, such as schizotypy, influence decision-making strategies related to flexible control.