Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

292
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
292

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

No effect of acute pain or self-reported chronic pain on working memory in the Sternberg task.

Scientific reports·2026
Same author

Modeling the journey as well as the destination: a control theory account of rotational navigation.

bioRxiv : the preprint server for biology·2026
Same author

Decomposing trust-related decision making: Dimensionality and predictability of phishing susceptibility in an adult lifespan sample.

The journals of gerontology. Series B, Psychological sciences and social sciences·2026
Same author

The Social Iowa Gambling Task: a promising tool for assessing deception detection in real-world contexts in adulthood.

The journals of gerontology. Series B, Psychological sciences and social sciences·2026
Same author

A novel approach-avoidance task to study decision making under outcome uncertainty.

Psychonomic bulletin & review·2026
Same author

Separating random and deterministic sources of computational noise in explore-exploit decisions.

PLoS computational biology·2026

Related Experiment Video

Updated: Dec 27, 2025

The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies
08:24

The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies

Published on: August 25, 2023

1.0K

Temporal discounting correlates with directed exploration but not with random exploration.

Hashem Sadeghiyeh1,2, Siyu Wang3, Maxwell R Alberhasky4

  • 1Department of Psychology, University of Arizona, Tucson, USA. sadeghiyeh@email.arizona.edu.

Scientific Reports
|March 6, 2020
PubMed
Summary

Individuals who discount future rewards more heavily engage in less directed exploration, revealing a nuanced link between temporal discounting and decision-making strategies.

More Related Videos

Measuring Delay Discounting in Humans Using an Adjusting Amount Task
07:47

Measuring Delay Discounting in Humans Using an Adjusting Amount Task

Published on: January 9, 2016

15.9K
Errors as a Means of Reducing Impulsive Food Choice
07:07

Errors as a Means of Reducing Impulsive Food Choice

Published on: June 5, 2016

9.0K

Related Experiment Videos

Last Updated: Dec 27, 2025

The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies
08:24

The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies

Published on: August 25, 2023

1.0K
Measuring Delay Discounting in Humans Using an Adjusting Amount Task
07:47

Measuring Delay Discounting in Humans Using an Adjusting Amount Task

Published on: January 9, 2016

15.9K
Errors as a Means of Reducing Impulsive Food Choice
07:07

Errors as a Means of Reducing Impulsive Food Choice

Published on: June 5, 2016

9.0K

Area of Science:

  • Cognitive psychology
  • Decision science
  • Neuroscience

Background:

  • The explore-exploit dilemma involves balancing seeking new information against using known strategies.
  • Valuing future rewards is theoretically linked to exploration, with lower temporal discounting predicting more exploration.

Purpose of the Study:

  • To empirically test the relationship between individual differences in temporal discounting and explore-exploit behaviors.
  • To investigate how temporal discounting influences directed and random exploration strategies.

Main Methods:

  • Assessed temporal discounting using the 27-item Delay-Discounting Questionnaire.
  • Quantified explore-exploit behavior (directed and random exploration) via the Horizon Task.

Main Results:

  • A significant negative correlation was found between temporal discounting and directed exploration.
  • No significant relationship was observed between temporal discounting and random exploration.
  • Directed exploration's link to temporal discounting was unexpectedly associated with uncertainty seeking over short horizons.

Conclusions:

  • Temporal discounting significantly influences directed exploration, but not random exploration.
  • The relationship is complex, potentially mediated by uncertainty seeking at shorter time frames.
  • Findings suggest a nuanced understanding of decision-making under uncertainty is required.