Time-based reward maximization.

Area of Science:

• Cognitive Neuroscience
• Behavioral Economics
• Psychology

Background:

• Human and animal timing abilities exhibit high accuracy but limited precision.
• Time-based decisions involve inherent endogenous timing uncertainty, necessitating temporal risk assessment.
• Understanding how individuals manage timing uncertainty for reward is crucial for decision-making models.

Purpose of the Study:

• To investigate human temporal risk assessment abilities in a reward-maximization task.
• To determine if participants could adaptively adjust response timing based on uncertainty and reward structure.
• To evaluate performance against an optimality framework considering timing uncertainty and payoff.

Main Methods:

• Participants performed a key-pressing task over eight sessions, aiming to maximize reward by withholding responses for a minimum duration.
• Trial time was reset with each response, with premature responses penalized in Experiment 2 but not Experiment 1.
• Empirical performance was analyzed using an optimality framework based on endogenous timing uncertainty and payoff structure.

Main Results:

• Participants rapidly and abruptly acquired optimal target inter-response times (IRTs), which varied with timing uncertainty.
• Performance closely tracked optimal IRTs, maximizing the reward rate in both experiments.
• No significant improvement or decline in performance was observed after initial acquisition.

Conclusions:

• Humans demonstrate optimal temporal risk assessment by balancing response speed and accuracy for reward maximization.
• The study provides evidence for adaptive, near-optimal performance in a task requiring trade-offs under timing uncertainty.
• Findings highlight the brain's capacity to adjust timing strategies based on environmental demands and internal states.