Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

927
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
927
Reason and Intuition01:37

Reason and Intuition

5.9K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
5.9K
Decision Making01:20

Decision Making

1.2K
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
1.2K
Reinforcement Schedules01:24

Reinforcement Schedules

740
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
740
Decision Making: Traditional Method01:14

Decision Making: Traditional Method

4.4K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.4K
Decision Making: P-value Method01:09

Decision Making: P-value Method

5.8K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim  is also stated. These statements can act as null and alternative hypotheses:  a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.8K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Value coding by primate amygdala neurons complies with the continuity axiom of economic choice theory.

Journal of neurophysiology·2026
Same author

Full dopamine coding of basic economic subjective value: Utility and weighted probability.

Cell reports·2026
Same author

Fluorescence detection of dopamine signaling to the primate striatum in relation to stimulus-reward associations.

Proceedings of the National Academy of Sciences of the United States of America·2025
Same author

Social Risk Coding by Amygdala Activity and Connectivity with the Dorsal Anterior Cingulate Cortex.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2024
Same author

Dopamine neurons encode trial-by-trial subjective reward value in an auction-like task.

Nature communications·2024
Same author

A dopamine mechanism for reward maximization.

Proceedings of the National Academy of Sciences of the United States of America·2024
Same journal

The microlandscapes of tree trunks: the effect of lichen and tree-level characteristics on arthropod communities.

Philosophical transactions of the Royal Society of London. Series B, Biological sciences·2026
Same journal

Centimetre-scale landscapes to assess the motion behaviour and cognition of gastropods and bivalves.

Philosophical transactions of the Royal Society of London. Series B, Biological sciences·2026
Same journal

Intertidal microcosms of wave-swept rocky shores: ecological and physiological insights from a uniquely stressful environment.

Philosophical transactions of the Royal Society of London. Series B, Biological sciences·2026
Same journal

Temporal and spatial variation in temperature and oxygen at the microscale: key niche axes for aquatic life.

Philosophical transactions of the Royal Society of London. Series B, Biological sciences·2026
Same journal

Natural microcosms in ecology: fulfilling the promise of model systems?

Philosophical transactions of the Royal Society of London. Series B, Biological sciences·2026
Same journal

Microbe-induced galls and plant defence: metabolite crosstalk in a co-evolutionary battle.

Philosophical transactions of the Royal Society of London. Series B, Biological sciences·2026
See all related articles

Related Experiment Video

Updated: May 3, 2026

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
07:05

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published on: September 10, 2018

5.2K

Timing in reward and decision processes.

Maria A Bermudez1, Wolfram Schultz

  • 1Department of Physiology, Development and Neuroscience, University of Cambridge, , Cambridge, UK.

Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences
|January 22, 2014
PubMed
Summary
This summary is machine-generated.

Organisms

Keywords:
amygdaladopaminefrontal cortexreward expectationstriatumtemporal discounting

More Related Videos

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
09:12

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

Published on: March 17, 2019

9.6K
An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in Free Moving Rodents
07:42

An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in Free Moving Rodents

Published on: August 2, 2018

14.2K

Related Experiment Videos

Last Updated: May 3, 2026

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
07:05

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published on: September 10, 2018

5.2K
Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
09:12

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

Published on: March 17, 2019

9.6K
An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in Free Moving Rodents
07:42

An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in Free Moving Rodents

Published on: August 2, 2018

14.2K

Area of Science:

  • Neuroscience
  • Behavioral Biology
  • Cognitive Science

Background:

  • Temporal sensitivity, particularly to reward timing, is crucial for organismal behavior.
  • Major brain reward structures, including dopamine neurons, striatum, frontal cortex, and amygdala, process reward occurrence time.

Purpose of the Study:

  • To investigate how internal timing mechanisms influence neuronal reward processing.
  • To determine if neuronal reward responses are sensitive to the predicted time of rewards and reward probability.

Main Methods:

  • The study reviews existing research on neuronal reward processing and temporal sensitivity.
  • Analysis focuses on findings from dopamine neurons, striatum, frontal cortex, and amygdala.

Main Results:

  • Neuronal reward responses in dopamine neurons, striatum, and frontal cortex exhibit temporal discounting of reward value.
  • Dopamine neurons' prediction error signals incorporate the predicted time of rewards.
  • Striatal, frontal cortical, and amygdalar neurons show reward-related activity sensitive to predicted reward timing and probability.

Conclusions:

  • Internal timing processes significantly impact neuronal reward processing across key brain regions.
  • These findings highlight the integration of temporal information in reward-based decision-making and behavior guidance.