Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Dopamine, uncertainty and TD learning.

Yael Niv1, Michael O Duff, Peter Dayan

  • 1Interdisciplinary Center for Neural Computation, Hebrew University, Jerusalem, Israel. yael@gatsby.ucl.ac.uk

Behavioral and Brain Functions : BBF
|June 15, 2005
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Latent subdimensions of anxiety and depression differentially influence exertion of effort in pursuit of reward versus avoidance of threat.

Translational psychiatry·2026
Same author

Neural signatures of model-based and model-free reinforcement learning across prefrontal cortex and striatum.

eLife·2026
Same author

Uncertainty for better and worse.

Current opinion in neurobiology·2026
Same author

Protocol for a randomized trial to predict the efficacy of cognitive and behavioral interventions for symptoms of depression.

Frontiers in psychiatry·2026
Same author

Dopamine dynamics in human anterior cingulate cortex during Pavlovian-instrumental conflict.

bioRxiv : the preprint server for biology·2026
Same author

Modality-general sensitivity of pupil responses to regularity violations.

Cognitive, affective & behavioral neuroscience·2026
Same journal

Alterations in glutamatergic and GABAergic signaling in ketamine-induced neurotoxicity: mangiferin mitigates neurochemical, oxidative, and astrocytic dysregulation in the rat temporal-frontal cortex.

Behavioral and brain functions : BBF·2026
Same journal

Ketamine enhances histone H3 (Ser10) phosphorylation via JNK signaling and multi-omics profiling of the hippocampus in a psychotic-like mouse model.

Behavioral and brain functions : BBF·2026
Same journal

Ginkgo biloba extract mitigates behavioral deficits, oxidative stress, and hippocampal remodeling in a rat model of PTSD.

Behavioral and brain functions : BBF·2026
Same journal

Rich-club organization and functional brain network metrics during facial emotional processing: a task-based fMRI study.

Behavioral and brain functions : BBF·2026
Same journal

Postpartum enhancement of spatial learning and cognitive flexibility: an IntelliCage study.

Behavioral and brain functions : BBF·2026
Same journal

Developmental trajectories of prefrontal activation underlying emotional inhibitory control from adolescence to young adulthood: a functional near-infrared spectroscopy study.

Behavioral and brain functions : BBF·2026
See all related articles

Dopamine neuron activity, specifically temporal difference (TD) error signaling, shows asymmetric representation due to low baseline firing. This asymmetry explains observed ramping activity in dopamine neurons during probabilistic reward learning.

Area of Science:

  • Neuroscience
  • Computational Psychiatry
  • Reinforcement Learning

Background:

  • Dopaminergic neurons in the primate midbrain are thought to encode temporal difference (TD) errors, signaling reward prediction errors.
  • These neurons exhibit increases and decreases in firing rate relative to baseline for positive and negative prediction errors, respectively.
  • Dopamine cells possess very low baseline activity, leading to an asymmetric representation of positive and negative prediction errors.

Purpose of the Study:

  • To explore the implications of the asymmetric representation of reward prediction errors by dopaminergic neurons.
  • To investigate how low baseline dopamine activity influences the interpretation of firing patterns during probabilistic reward learning.
  • To explain the observed ramping activity in dopamine neurons in the context of persistent prediction errors.

Related Experiment Videos

Main Methods:

  • Theoretical analysis of dopaminergic firing patterns under conditions of probabilistic rewards and persistent prediction errors.
  • Mathematical modeling to predict the average firing activity of dopamine neurons across trials.
  • Comparison of model predictions with empirical findings from a recent experimental study.

Main Results:

  • Averaging non-stationary prediction errors across trials predicts a ramping in dopamine neuron activity.
  • The magnitude of this observed ramping is dependent on the learning rate parameter.
  • This ramping phenomenon, previously interpreted as within-trial uncertainty encoding, is explained by the TD error asymmetry.

Conclusions:

  • The low baseline activity of dopamine neurons creates an asymmetric representation of reward prediction errors.
  • This asymmetry mathematically predicts and explains the observed ramping activity in dopaminergic neurons during learning.
  • The findings offer a revised interpretation of dopamine neuron firing patterns, linking them directly to TD error signaling and learning rates.