Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

255
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
255

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A single reinforcement learning model to unify habit formation and Pavlovian-instrumental interaction.

Scientific reports·2026
Same author

Filling, color, and shape: individuality in chimpanzee drawings.

Primates; journal of primatology·2026
Same author

Spatial strategies in non-territorial societies: how feral horses maintain boundaries with other groups.

Proceedings. Biological sciences·2026
Same author

Dorsomedial striatum monitors unreliability of current action policy and probes alternative one via the indirect pathway.

Science advances·2025
Same author

Correction to 'Inter-species differences in wound-healing rate: a comparative study involving primates and rodents' (2025), by Matsumoto-Oda <i>et al</i>.

Proceedings. Biological sciences·2025
Same author

A State-Transition-Free Delayed-Feedback Task Elicits Heterogeneous Human Responses.

Journal of cognition·2025
Same journal

Personality, happiness, and health in gibbons.

Journal of comparative psychology (Washington, D.C. : 1983)·2026
Same journal

Cognitive differences between two Zebra species (Equus burchelli chapmanni and E. grevyi)-The possible role of fission-fusion dynamics.

Journal of comparative psychology (Washington, D.C. : 1983)·2026
Same journal

Salt exposure disrupts memory retrieval in habituation and conditioned place preference in planaria (Dugesia japonica).

Journal of comparative psychology (Washington, D.C. : 1983)·2026
Same journal

Evidence of the conjunction fallacy in Rats (Rattus norvegicus) following two-lever choice training.

Journal of comparative psychology (Washington, D.C. : 1983)·2026
Same journal

Do animals treat their minds? From wild stories to lab-built realities.

Journal of comparative psychology (Washington, D.C. : 1983)·2026
Same journal

The SNARC effect is not a unitary phenomenon: Individual variation in space-magnitude associations across domains.

Journal of comparative psychology (Washington, D.C. : 1983)·2026
See all related articles

Related Experiment Video

Updated: Nov 28, 2025

Measuring Delay Discounting in Humans Using an Adjusting Amount Task
07:47

Measuring Delay Discounting in Humans Using an Adjusting Amount Task

Published on: January 9, 2016

15.8K

Computerized intertemporal choice task in chimpanzees (Pan troglodytes) with/without postreward delay.

Yutaro Sato1, Yutaka Sakai2, Satoshi Hirata1

  • 1Wildlife Research Center.

Journal of Comparative Psychology (Washington, D.C. : 1983)
|November 30, 2020
PubMed
Summary
This summary is machine-generated.

Chimpanzees show self-control in intertemporal choice (ITC) tasks. However, their ability to manage post-reward delays (PRDs) in ITC tasks requires further investigation.

More Related Videos

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
07:05

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published on: September 10, 2018

6.3K
Errors as a Means of Reducing Impulsive Food Choice
07:07

Errors as a Means of Reducing Impulsive Food Choice

Published on: June 5, 2016

9.0K

Related Experiment Videos

Last Updated: Nov 28, 2025

Measuring Delay Discounting in Humans Using an Adjusting Amount Task
07:47

Measuring Delay Discounting in Humans Using an Adjusting Amount Task

Published on: January 9, 2016

15.8K
Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
07:05

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published on: September 10, 2018

6.3K
Errors as a Means of Reducing Impulsive Food Choice
07:07

Errors as a Means of Reducing Impulsive Food Choice

Published on: June 5, 2016

9.0K

Area of Science:

  • Cognitive psychology
  • Animal behavior
  • Neuroscience

Background:

  • Intertemporal choice (ITC) tasks involve choosing between immediate smaller rewards and delayed larger rewards.
  • Post-reward delays (PRDs) are used to equalize trial durations but can complicate choice contingencies.
  • Chimpanzees exhibit strong self-control in ITC tasks, but their response to PRDs is not well understood.

Purpose of the Study:

  • To investigate chimpanzee intertemporal preferences when trial duration is equated by PRDs versus when PRDs are absent.
  • To explore the impact of PRDs on chimpanzees' decision-making in ITC tasks using a controlled touchscreen environment.

Main Methods:

  • Touchscreen experiments were employed to precisely control delay durations and minimize experimenter interaction.
  • Symbolic cues were used for reward options to reduce the influence of visible food rewards.
  • Chimpanzees' choices between immediate smaller and delayed larger rewards were recorded under conditions with and without PRDs.

Main Results:

  • When trial duration was equated by PRDs, chimpanzees preferred larger rewards but opted for smaller, sooner rewards more frequently with smaller reward amount ratios.
  • In the absence of PRDs, two out of four chimpanzees shifted preference to smaller, sooner rewards, improving their overall reward rate, despite methodological limitations.

Conclusions:

  • Chimpanzees' intertemporal decision-making is influenced by post-reward delays.
  • Further research is needed to fully understand chimpanzee self-control in intertemporal choice tasks involving complex reward contingencies.