Sensitivity to changing contingencies in an impulsivity task.

Area of Science:

• Behavioral economics
• Decision-making science

Background:

• Understanding how individuals adjust their decision-making strategies in response to changing reward structures is crucial.
• Previous research has explored delay discounting and reinforcement learning, but the impact of sequential, shifting reward contingencies requires further investigation.

Purpose of the Study:

• To investigate how participants adapt their waiting behavior in a dynamic reward environment.
• To examine the influence of previously experienced reward contingencies on current decision-making.

Main Methods:

• A video-game-based escalating interest task was employed, where participants waited for rewards that increased in value over time.
• Participants experienced four distinct reward contingencies, which were altered multiple times during the experiment.
• Behavioral responses, specifically wait times, were recorded and analyzed in relation to the changing reward structures.

Main Results:

• Participant behavior adapted to the current reward contingencies, demonstrating learning.
• However, wait times showed significant carryover effects from previously experienced contingencies, indicating persistent influence.
• The order in which participants encountered different reward contingencies impacted both their tendency to respond slowly and the overall optimality of their choices.

Conclusions:

• Decision-making under shifting reward contingencies is influenced by both immediate feedback and the history of reinforcement.
• The sequential presentation of reward structures can lead to suboptimal choices due to carryover effects.
• Future research should consider the temporal dynamics of reward history in models of choice behavior.