Related Experiment Video
Updated: Sep 7, 2026

Measuring Delay Discounting in Humans Using an Adjusting Amount Task
Published on: January 9, 2016
Associations Between Steep Delay Discounting and Punishment Learning
Jeremy Haynes1, Peter Kvam2, Thomas Olino3
1Georgia Southern University, US.
Abstract:
Reward valuation and reward and punishment learning are important constructs for understanding and intervening on mental illness. These constructs are frequently measured with behavioral tasks such as intertemporal choice tasks, measuring delay discounting, and the Iowa Gambling Task (IGT), measuring reward and punishment learning. Delay discounting refers to how people value delayed outcomes, with steep discounting (i.e., delayed outcomes holding little value) considered a form of impulsive decision-making. Reward and punishment learning refers to how people adjust their decision behavior in response to rewards and punishments, with deficits indicating atypical reward and punishment processing related to clinical outcomes such as substance abuse. In this study, we tested the association between delay discounting and computational measures of reward and punishment learning in adults (N = 299) that completed an intertemporal choice task and the play-or-pass IGT. We fit a joint model to the task data to simultaneously estimate parameters from the hyperbolic discounting model (for the intertemporal choice task) and a reinforcement learning model (for the play-or-pass IGT). Our results indicate that steep delay discounting is associated with lower performance on the IGT, specifically through lower punishment learning. That is, people who do not value delayed outcomes also show less learning from punishment, resulting in worse performance in the IGT. Implications of these findings are discussed in the context of improving assessment of reward valuation and reward and punishment learning as constructs relevant to mental illness.
Related Concept Videos
Timing and Consequences on Behavior
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Associative Learning
Classical conditioning, also known...
Punishment
Punishment can be positive or negative. Positive punishment involves adding an undesirable stimulus, such as scolding, to decrease a behavior. Negative punishment involves removing a desirable stimulus, such as taking away a favorite toy, to decrease behavior.
Generalization, Discrimination, and Extinction
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Operant Conditioning
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Law of Effect
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...

