Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

161
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
161

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The quantitative economon model as a novel computational tool for addiction research.

Experimental and clinical psychopharmacology·2026
Same author

Reward-specific learning parameters change across normative adolescent development and are blunted in youth with high risk for depression.

Journal of child psychology and psychiatry, and allied disciplines·2025
Same author

Delay Discounting Within Couple Relationships: An Initial Exploration.

Journal of marital and family therapy·2025
Same author

Reward and punishment learning among people with a lifetime history of anxiety, depression, and substance use disorder.

Cognitive, affective & behavioral neuroscience·2025
Same author

Quantitative Economon Model of Transactions for Drugs and Other Commodities.

bioRxiv : the preprint server for biology·2025
Same author

The rodent electronic nicotine delivery system: Apparatus for voluntary nose-only e-cigarette aerosol inhalation.

Journal of the experimental analysis of behavior·2025
Same journal

The Genoeconomics of Impulsive Intertemporal Choice: A Critical Review.

Journal of the experimental analysis of behavior·2026
Same journal

Shaping the extinction burst: Increasing its probability and preventing its emergence across topographies.

Journal of the experimental analysis of behavior·2026
Same journal

Evaluating the combined effects of effort and probability on monetary discounting.

Journal of the experimental analysis of behavior·2026
Same journal

An improved translational approach to studying persistence-strengthening effects of differential reinforcement of alternative behavior.

Journal of the experimental analysis of behavior·2026
Same journal

Interactions between the effects of food and water motivating operations on concurrent food- and water-reinforced responding in mice.

Journal of the experimental analysis of behavior·2026
Same journal

Odor-visual and visual-visual matching to sample with dogs.

Journal of the experimental analysis of behavior·2026
See all related articles

Related Experiment Video

Updated: Sep 25, 2025

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
09:12

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

Published on: March 17, 2019

9.6K

Testing delay of gratification in rats using a within-session increasing-delay task.

Jeremy M Haynes1, Amy L Odum1

  • 1Utah State University.

Journal of the Experimental Analysis of Behavior
|April 29, 2022
PubMed
Summary
This summary is machine-generated.

Rats demonstrated preference reversals in delay discounting tasks, choosing smaller-sooner rewards. However, experience with delay of gratification or intertemporal choice reduced these reversals, suggesting inhibitory control or temporal learning may be involved.

Keywords:
delay discountingdelay of gratificationgeneralized linear mixed modelingpreference reversalsrat

More Related Videos

Testing for Metacognitive Responding Using an Odor-based Delayed Match-to-Sample Test in Rats
08:06

Testing for Metacognitive Responding Using an Odor-based Delayed Match-to-Sample Test in Rats

Published on: June 18, 2018

7.3K
The 5-Choice Serial Reaction Time Task: A Task of Attention and Impulse Control for Rodents
09:43

The 5-Choice Serial Reaction Time Task: A Task of Attention and Impulse Control for Rodents

Published on: August 10, 2014

46.3K

Related Experiment Videos

Last Updated: Sep 25, 2025

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
09:12

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

Published on: March 17, 2019

9.6K
Testing for Metacognitive Responding Using an Odor-based Delayed Match-to-Sample Test in Rats
08:06

Testing for Metacognitive Responding Using an Odor-based Delayed Match-to-Sample Test in Rats

Published on: June 18, 2018

7.3K
The 5-Choice Serial Reaction Time Task: A Task of Attention and Impulse Control for Rodents
09:43

The 5-Choice Serial Reaction Time Task: A Task of Attention and Impulse Control for Rodents

Published on: August 10, 2014

46.3K

Area of Science:

  • Behavioral economics
  • Animal cognition
  • Neuroscience

Background:

  • Delay discounting describes preference shifts from larger-later to smaller-sooner rewards.
  • Steep hyperbolic discounting predicts preference reversals as rewards approach.
  • Prior research shows inconsistencies regarding reversals after choosing larger-later rewards.

Purpose of the Study:

  • To replicate and extend findings on preference reversals in delay discounting using a rat model.
  • To investigate the role of experience in modulating preference reversals.
  • To explore potential mechanisms like inhibitory control and temporal learning.

Main Methods:

  • A delay of gratification task was employed with rats.
  • A 'defection response' allowed rats to switch from a larger-later to a smaller-sooner reward.
  • Experiment 1: Rats experienced the delay of gratification task. Experiment 2: Rats experienced an intertemporal choice task without defection opportunity prior to the delay of gratification task.

Main Results:

  • Rats exhibited preference reversals by defecting on larger-later rewards, consistent with prior research.
  • Experience with the delay of gratification task decreased defection responses.
  • Prior experience with intertemporal choice tasks also led to fewer defection responses.

Conclusions:

  • Rats' behavior in delay discounting is replicable.
  • Experience significantly influences the occurrence of preference reversals.
  • Findings suggest that inhibitory control or temporal learning mechanisms may underlie delay of gratification behavior.