Related Experiment Video
Updated: Aug 7, 2026
07:47
Measuring Delay Discounting in Humans Using an Adjusting Amount Task
Published on: January 9, 2016
Choice between rewards differing in amount and delay: Toward a choice model of self control
Journal of the Experimental Analysis of Behavior
|September 1, 1980
Summary
Pigeons
Area of Science:
- Behavioral science
- Animal behavior
- Decision-making studies
Background:
- Understanding choice behavior is crucial for behavioral economics and psychology.
- Self-control is often modeled as a choice between immediate and delayed rewards.
Purpose of the Study:
- To investigate how pigeons choose between rewards with varying amounts and delays.
- To test the predictions of existing choice models under different delay conditions.
Main Methods:
- A concurrent-chain procedure was employed with pigeons.
- Rewards varied in grain access duration (amount) and delay time.
- Delay ratios of 6:1, 3:1, and 3:2 were examined.
Main Results:
- Preference for larger, delayed rewards decreased as absolute delays increased under 6:1 and 3:1 ratios.
- Preference for larger, delayed rewards increased under the 3:2 ratio.
- Results challenge models assuming constant preference with fixed reward/delay ratios.
Conclusions:
- Delay is a more significant factor than amount in pigeon choice behavior.
- Findings suggest limitations in current models of self-control and decision-making.
- Further research is needed to refine choice models for delayed rewards.
Related Concept Videos
01:08Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
02:45Self-Discrepancy Theory
One influential perspective on what motivates people's behavior is detailed in Tory Higgin's self-discrepancy theory (Higgins, 1987). He proposed that people hold disagreeing internal representations of themselves that lead to different emotional states.
01:25Self-Regulation
Self-regulation, also known as self-control, encompasses a range of cognitive and behavioral processes that allow individuals to adjust their internal states and outward actions to align with socially acceptable norms and long-term goals. It plays a fundamental role in adaptive functioning, from resisting impulsive behaviors to persisting through challenging tasks. While its benefits are widely recognized, self-regulation is not limitless. Muraven and Baumeister's theory posits that...
01:24Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
01:18Incentive Theory: Pull Theory of Motivation
Incentive theory, or the "pull theory" of motivation, suggests that external rewards primarily drive behavior. Individuals are motivated to engage in activities when they anticipate a desirable outcome. This is why people often work hard for promotions or study intensively to achieve high grades. These incentives can be tangible, physical rewards such as money or promotions, or intangible, non-physical rewards like praise and social recognition.
The theory differentiates between intrinsic and...
The theory differentiates between intrinsic and...
01:23Primary and Secondary Reinforcers
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...