Related Experiment Video
Updated: May 29, 2026
07:47
Measuring Delay Discounting in Humans Using an Adjusting Amount Task
Published on: January 9, 2016
When is it adaptive to be patient? A general framework for evaluating delayed rewards.
Tim W Fawcett1, John M McNamara, Alasdair I Houston
1School of Biological Sciences, University of Bristol, Woodland Road, Bristol BS8 1UG, UK. tim.fawcett@cantab.net
Behavioural Processes
|September 17, 2011
Summary
Animal impulsiveness, or seeking immediate rewards, is not always irrational. Optimal behavior depends on factors like choice repetition and available opportunities, challenging standard self-control models.
Area of Science:
- Behavioral Ecology
- Evolutionary Psychology
- Animal Behavior
Background:
- Animals often exhibit a preference for immediate rewards over larger, delayed ones, a behavior termed impulsiveness.
- This tendency is commonly viewed as irrational or a lack of self-control.
- Explaining the evolutionary basis of such seemingly suboptimal decision-making is a key question.
Purpose of the Study:
- To analyze optimal decision-making strategies in animals facing choices between immediate and delayed rewards.
- To investigate the factors influencing preferences for immediate versus delayed gratification.
- To challenge conventional models of animal self-control and impulsiveness.
Main Methods:
- Analysis of optimal behavior in simulated choice scenarios involving delayed rewards.
- Modeling the influence of choice repetition, reward availability, and alternative opportunities on reward discounting.
- Critique of standard laboratory tests for impulsiveness based on ecological relevance.
Main Results:
- Optimal reward discounting is not always exponential; it depends on situational factors.
- Preferences for immediate rewards are influenced by whether choices are repeated and information about reward availability.
- Preference reversals are predicted when delaying rewards leads to opportunity costs, with directionality dependent on choice repetition.
Conclusions:
- Animal impulsiveness can be an adaptive strategy shaped by ecological factors, not necessarily irrational.
- Standard laboratory self-control paradigms may lack ecological validity.
- Future research should focus on adaptive decision rules in realistic ecological settings to understand the evolution of impulsiveness.
More Related Videos
Related Concept Videos
01:08Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
01:24Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
03:26Framing Effects
Information is everywhere and its presentation—such as how and when items are presented—can impact our perceptions and decisions surrounding the info. This broad concept umbrellas framing effects—influences that occur due to the way information is framed in its appearance, whether it’s purely the order or the specific wording of a message. Let’s take a look at numerous ways in which two versions of something can objectively say the same thing, yet we respond in different ways based on the...
01:23Primary and Secondary Reinforcers
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...