Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Long-term Potentiation01:35

Long-term Potentiation

Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Long-term Potentiation01:25

Long-term Potentiation

Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Hebbian LTP
LTP can occur when presynaptic neurons...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Use of Digital Peer Support for Employee Well-Being: Retrospective Analysis Across Five Large Employers.

JMIR human factors·2026
See all related articles

Related Experiment Video

Updated: Jul 6, 2026

Organotypic Slice Cultures of Embryonic Ventral Midbrain: A System to Study Dopaminergic Neuronal Development in vitro
07:33

Organotypic Slice Cultures of Embryonic Ventral Midbrain: A System to Study Dopaminergic Neuronal Development in vitro

Published on: January 31, 2012

18.0K

Neuronal implementation of the temporal difference learning algorithm in the midbrain dopaminergic system.

Anya Stetsenko1, Tibor Koos1

  • 1Center for Molecular and Behavioral Neuroscience, Rutgers University, Newark, NJ 07102.

Proceedings of the National Academy of Sciences of the United States of America
|October 30, 2023
PubMed
Summary

Researchers found that ventral tegmental area (VTA) GABAergic neurons implement the temporal difference learning (TDL) algorithm. This circuitry explains reward prediction errors and temporal discounting in reinforcement learning (RL).

Keywords:
basal gangliadopaminereinforcement learningtemporal difference learning modelventral tegmental area

More Related Videos

Environmental Modulations of the Number of Midbrain Dopamine Neurons in Adult Mice
09:35

Environmental Modulations of the Number of Midbrain Dopamine Neurons in Adult Mice

Published on: January 20, 2015

8.8K
Isolation, Culture and Long-Term Maintenance of Primary Mesencephalic Dopaminergic Neurons From Embryonic Rodent Brains
08:45

Isolation, Culture and Long-Term Maintenance of Primary Mesencephalic Dopaminergic Neurons From Embryonic Rodent Brains

Published on: February 19, 2015

14.1K

Related Experiment Videos

Last Updated: Jul 6, 2026

Organotypic Slice Cultures of Embryonic Ventral Midbrain: A System to Study Dopaminergic Neuronal Development in vitro
07:33

Organotypic Slice Cultures of Embryonic Ventral Midbrain: A System to Study Dopaminergic Neuronal Development in vitro

Published on: January 31, 2012

18.0K
Environmental Modulations of the Number of Midbrain Dopamine Neurons in Adult Mice
09:35

Environmental Modulations of the Number of Midbrain Dopamine Neurons in Adult Mice

Published on: January 20, 2015

8.8K
Isolation, Culture and Long-Term Maintenance of Primary Mesencephalic Dopaminergic Neurons From Embryonic Rodent Brains
08:45

Isolation, Culture and Long-Term Maintenance of Primary Mesencephalic Dopaminergic Neurons From Embryonic Rodent Brains

Published on: February 19, 2015

14.1K

Area of Science:

  • Neuroscience
  • Computational Neuroscience
  • Machine Learning

Background:

  • The temporal difference learning (TDL) algorithm is crucial for understanding dopamine's role in reinforcement learning (RL).
  • A neuronal basis for the TDL algorithm in the brain remains largely uncharacterized.
  • Ventral tegmental area (VTA) GABAergic neurons exhibit recently described signaling properties.

Purpose of the Study:

  • To investigate whether a neuronal implementation of the TDL algorithm exists in the brain.
  • To interpret the signaling properties of VTA GABAergic neurons as a TDL circuit.
  • To elucidate the computational mechanisms underlying reinforcement learning in biological systems.

Main Methods:

  • Interpreting VTA GABAergic neuron signaling properties.
  • Identifying neuronal mechanisms for TDL components: state value, reward prediction (RP), and reward prediction errors (RPEs).
  • Utilizing computational modeling to analyze the circuit's biophysical adaptation and functional implications.

Main Results:

  • A circuitry of VTA GABAergic neurons was shown to implement the TDL algorithm.
  • A sustained state value signal is encoded by VTA afferent input.
  • A temporal differentiation circuit in VTA GABAergic neurons computes momentary reward prediction, and RPEs are computed in dopamine neurons.

Conclusions:

  • The identified neuronal circuitry provides a mechanistic basis for the TDL algorithm in the brain.
  • This mechanism links conditioned reinforcement to reward prediction and explains temporal discounting.
  • Elucidating this TDL implementation advances the study of RL in both biological and artificial systems.