Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Observational Learning

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...

Propagation of Uncertainty from Systematic Error

Propagation of Uncertainty from Systematic Error

The atomic mass of an element varies due to the relative ratio of its isotopes. A sample's relative proportion of oxygen isotopes influences its average atomic mass. For instance, if we were to measure the atomic mass of oxygen from a sample, the mass would be a weighted average of the isotopic masses of oxygen in that sample. Since a single sample is not likely to perfectly reflect the true atomic mass of oxygen for all the molecules of oxygen on Earth, the mass we obtain from this...

Propagation of Uncertainty from Random Error

Propagation of Uncertainty from Random Error

An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...

Decision Making: P-value Method

Decision Making: P-value Method

The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...

Time-Domain Interpretation of PD Control

Time-Domain Interpretation of PD Control

Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...

Associative Learning

Associative Learning

Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

The Effect of Reward Magnitude on Different Types of Exploration in Human Reinforcement Learning.

Computational brain & behavior·2026

Same author

State Optimism as a State-Dependent Prior About Rewarding Outcomes.

Computational brain & behavior·2026

Same author

Sustained activity of human substantia nigra neurons reflect prior rewards.

iScience·2026

Same author

Mesocorticostriatal Reinforcement Learning of State Representation and Value with Implications for the Mechanisms of Schizophrenia.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2026

Same author

Identification of Mfa5-2 as a structural component of Mfa1 fimbriae in Porphyromonas gingivalis.

Journal of oral biosciences·2026

Same author

Dopamine and serotonin transients predict depressive symptom relief following deep brain stimulation of human subcallosal cingulate cortex.

bioRxiv : the preprint server for biology·2026

Search research articles

Related Experiment Video

Updated: Oct 3, 2025

Author Spotlight: Unveiling Neural Mechanisms Through Automated Evaluation of Motor Learning and Myelin Plasticity Studies Using the Erasmus Ladder

Author Spotlight: Unveiling Neural Mechanisms Through Automated Evaluation of Motor Learning and Myelin Plasticity Studies Using the Erasmus Ladder

Published on: December 15, 2023

Dopamine ramps for accurate value learning under uncertainty.

Kenji Morita¹, Ayaka Kato²

¹Physical and Health Education, Graduate School of Education, The University of Tokyo, Tokyo, Japan; International Research Center for Neurointelligence (WPI-IRCN), The University of Tokyo, Tokyo, Japan.

Trends in Neurosciences

|February 19, 2022

Summary

Dopamine signals ramping towards reward timings are reward prediction errors. These signals enable accurate value learning, especially when future states are uncertain and resolved by sensory feedback.

Keywords:

acetylcholine forgetting reinforcement learning reward prediction error time perception

More Related Videos

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

Published on: August 15, 2020

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

Related Experiment Videos

Last Updated: Oct 3, 2025

Author Spotlight: Unveiling Neural Mechanisms Through Automated Evaluation of Motor Learning and Myelin Plasticity Studies Using the Erasmus Ladder

Author Spotlight: Unveiling Neural Mechanisms Through Automated Evaluation of Motor Learning and Myelin Plasticity Studies Using the Erasmus Ladder

Published on: December 15, 2023

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

Published on: August 15, 2020

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

Area of Science:

Neuroscience
Computational Neuroscience
Decision Neuroscience

Background:

Dopamine signals ramping towards reward timings are frequently observed.
The precise function of these ramping dopamine signals remains unclear.

Purpose of the Study:

To investigate the functional role of ramping dopamine signals.
To determine if these signals are involved in value learning under uncertainty.

Main Methods:

Computational modeling analyses.
In vivo experiments conducted in mice.

Main Results:

Ramping dopamine signals were identified as reward prediction errors.
These signals facilitate accurate value learning in uncertain environments.
The resolution of state uncertainty via sensory feedback is crucial for this process.

Conclusions:

Ramping dopamine signals are not merely correlates but active components of value-based decision-making.
This finding sheds light on the neural mechanisms underlying learning and adaptation in dynamic environments.