The temporal dynamics of waiting when reward is increasing

Area of Science:

• Behavioral Economics
• Psychology
• Reinforcement Learning

Background:

• Temporal dynamics of waiting behavior are complex and influenced by reward schedules.
• Previous research identified two behavioral modes (rapid vs. slow responding) under different reinforcement conditions.

Purpose of the Study:

• To investigate the temporal dynamics of human waiting behavior under novel reinforcement contingencies.
• To identify distinct behavioral modes in response to a complex reward value function.

Main Methods:

• A video game was used to implement differential reinforcement of wait times.
• Reward magnitude was linked to the duration of inter-response times.
• Outcome values followed a pattern of linear increase, plateau, abrupt increase, and linear increase.

Main Results:

• Three distinct modes of wait times were observed in participants.
• These modes included immediate responding, responding after an abrupt value increase, and waiting for maximum reward.
• Behavioral modes were analyzed in relation to immediacy, molecular/molar maximization, and response ease.

Conclusions:

• The study demonstrates that complex reward schedules can elicit multiple, distinct waiting behaviors.
• Understanding these behavioral modes offers insights into decision-making under temporal constraints.
• Factors like desire for action and maximization strategies influence waiting patterns.