Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

190
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
190
Reinforcement Schedules01:24

Reinforcement Schedules

275
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
275

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Cancer outcomes and cardiopulmonary toxicities for Black patients with breast cancer treated with proton therapy.

JNCI cancer spectrum·2024
Same author

Anterior cingulate cortex lesions impair multiple facets of task engagement not mediated by dorsomedial striatum neuron firing.

Cerebral cortex (New York, N.Y. : 1991)·2024
Same author

Distinct Action Signals by Subregions in the Nucleus Accumbens during STOP-Change Performance.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2024
Same author

Optogenetic Inhibition of the Orbitofrontal Cortex Disrupts Inhibitory Control during Stop-Change Performance in Male Rats.

eNeuro·2024
Same author

Optogenetic Inhibition of Rat Anterior Cingulate Cortex Impairs the Ability to Initiate and Stay on Task.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2024
Same author

Minimal cross-trial generalization in learning the representation of an odor-guided choice task.

PLoS computational biology·2022
Same journal

Time does the teaching.

Journal of experimental psychology. Animal learning and cognition·2026
Same journal

Language learning in canines and toddlers: Shared origins?

Journal of experimental psychology. Animal learning and cognition·2026
Same journal

The role of outcome affective value in driving human Pavlovian learning.

Journal of experimental psychology. Animal learning and cognition·2026
Same journal

Crashing the tea party: Imagining alternative explanations.

Journal of experimental psychology. Animal learning and cognition·2026
Same journal

Static outcomes: Anodal transcranial direct current stimulation at Fp3 or P3 does not modulate perceptual learning as indexed by the intermixed-blocked effect.

Journal of experimental psychology. Animal learning and cognition·2026
Same journal

A method for visual psychophysics based on the navigational behavior of desert ants (Melophorus bagoti).

Journal of experimental psychology. Animal learning and cognition·2026
See all related articles

Related Experiment Video

Updated: Oct 21, 2025

Measuring Delay Discounting in Humans Using an Adjusting Amount Task
07:47

Measuring Delay Discounting in Humans Using an Adjusting Amount Task

Published on: January 9, 2016

15.7K

Rats delay gratification during a time-based diminishing returns task.

Douglas R Schuweiler1, Manaahil Rao1, Heather J Pribut1

  • 1Department of Psychology.

Journal of Experimental Psychology. Animal Learning and Cognition
|September 2, 2021
PubMed
Summary
This summary is machine-generated.

Rats demonstrated self-control in a decision-making task, choosing delayed gratification for greater long-term rewards. This study offers insights into the neural basis of self-control and potential treatments for related psychiatric conditions.

More Related Videos

Errors as a Means of Reducing Impulsive Food Choice
07:07

Errors as a Means of Reducing Impulsive Food Choice

Published on: June 5, 2016

8.9K
Automated, Long-term Behavioral Assay for Cognitive Functions in Multiple Genetic Models of Alzheimer's Disease, Using IntelliCage
06:46

Automated, Long-term Behavioral Assay for Cognitive Functions in Multiple Genetic Models of Alzheimer's Disease, Using IntelliCage

Published on: August 4, 2018

12.4K

Related Experiment Videos

Last Updated: Oct 21, 2025

Measuring Delay Discounting in Humans Using an Adjusting Amount Task
07:47

Measuring Delay Discounting in Humans Using an Adjusting Amount Task

Published on: January 9, 2016

15.7K
Errors as a Means of Reducing Impulsive Food Choice
07:07

Errors as a Means of Reducing Impulsive Food Choice

Published on: June 5, 2016

8.9K
Automated, Long-term Behavioral Assay for Cognitive Functions in Multiple Genetic Models of Alzheimer's Disease, Using IntelliCage
06:46

Automated, Long-term Behavioral Assay for Cognitive Functions in Multiple Genetic Models of Alzheimer's Disease, Using IntelliCage

Published on: August 4, 2018

12.4K

Area of Science:

  • Neuroscience
  • Behavioral Economics
  • Animal Models

Background:

  • Rats are crucial animal models for understanding decision-making and psychiatric disorders.
  • Assessing self-control and delayed gratification is vital for understanding behavioral regulation.

Purpose of the Study:

  • To investigate if rats can perform a decision-making task involving delayed gratification under diminishing returns.
  • To explore how rats adapt their behavior to maximize reward rates in a self-control task.

Main Methods:

  • Rats chose between a fixed delay (FD) lever and a progressive delay (PD) lever.
  • The PD lever's delay increased with each press, while the FD lever offered a reset option.
  • Two conditions were tested: reset (FD lever resets PD) and no-reset.

Main Results:

  • Rats adapted their strategy in the reset condition by using the FD lever to reset the PD schedule.
  • This behavior allowed rats to delay gratification and achieve a higher net rate of reward.
  • Results indicate rats can prioritize long-term gains over immediate rewards, consistent with other species.

Conclusions:

  • Rats exhibit self-control by strategically delaying gratification to maximize overall reward.
  • This rodent model of decision-making can illuminate the neural mechanisms of self-control.
  • Findings may inform treatments for psychiatric conditions involving impaired self-control.