Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Time-Domain Interpretation of PD Control

Time-Domain Interpretation of PD Control

Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...

Classification of Signals

Classification of Signals

In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Dopamine in the ventral and tail of striatum supports global and local evaluation in reward-threat conflict.

bioRxiv : the preprint server for biology·2026

Same author

Spectral envelopes of facial movements predict intention, cortical representations, and neural prosthetic control.

bioRxiv : the preprint server for biology·2026

Same author

A novel behavioral paradigm using mice to study predictive postural control.

Frontiers in neuroscience·2026

Same author

Phasic dopamine drives conditioned responding beyond its role in learning.

bioRxiv : the preprint server for biology·2026

Same author

Rapid homotopic communication between human orbitofrontal subregions.

Current biology : CB·2026

Same author

Context-specific configuration of orthogonal integrator dynamics for flexible foraging decisions.

bioRxiv : the preprint server for biology·2025

Search research articles

Related Experiment Video

Updated: Nov 30, 2025

Modeling Fast-scan Cyclic Voltammetry Data from Electrically Stimulated Dopamine Neurotransmission Data Using QNsim1.0

Modeling Fast-scan Cyclic Voltammetry Data from Electrically Stimulated Dopamine Neurotransmission Data Using QNsim1.0

Published on: June 5, 2017

Dopamine signals as temporal difference errors: recent advances.

Clara Kwon Starkweather¹, Naoshige Uchida¹

¹Center for Brain Science, Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA 02138, USA.

Current Opinion in Neurobiology

|November 13, 2020

Summary

This summary is machine-generated.

Dopamine neurons signal reward prediction errors, crucial for learning. When environments are uncertain, they use

More Related Videos

Dopamine Release at Individual Presynaptic Terminals Visualized with FFNs

Dopamine Release at Individual Presynaptic Terminals Visualized with FFNs

Published on: August 31, 2009

Single Cell Measurement of Dopamine Release with Simultaneous Voltage-clamp and Amperometry

Single Cell Measurement of Dopamine Release with Simultaneous Voltage-clamp and Amperometry

Published on: November 21, 2012

Related Experiment Videos

Last Updated: Nov 30, 2025

Modeling Fast-scan Cyclic Voltammetry Data from Electrically Stimulated Dopamine Neurotransmission Data Using QNsim1.0

Modeling Fast-scan Cyclic Voltammetry Data from Electrically Stimulated Dopamine Neurotransmission Data Using QNsim1.0

Published on: June 5, 2017

Dopamine Release at Individual Presynaptic Terminals Visualized with FFNs

Dopamine Release at Individual Presynaptic Terminals Visualized with FFNs

Published on: August 31, 2009

Single Cell Measurement of Dopamine Release with Simultaneous Voltage-clamp and Amperometry

Single Cell Measurement of Dopamine Release with Simultaneous Voltage-clamp and Amperometry

Published on: November 21, 2012

Area of Science:

Neuroscience
Computational Neuroscience
Machine Learning

Background:

Dopamine is theorized to mediate reward-based learning via temporal difference (TD) reward prediction errors.
Phasic dopamine signals have been experimentally linked to these TD errors.

Purpose of the Study:

To investigate the computation of TD errors by dopamine neurons under environmental uncertainty.
To explore the role of 'belief states' in dopamine-mediated learning.

Main Methods:

Optogenetic manipulations in neural circuits.
Analysis of dopamine neuron activity during learning tasks.

Main Results:

Dopamine neurons compute TD errors even in uncertain environments.
Evidence suggests the use of 'belief states' (probability distributions) for this computation.
Emerging evidence implicates the prefrontal cortex and hippocampus in belief state computation.

Conclusions:

Dopamine's role in learning is more nuanced, involving probabilistic computations.
These findings offer insights into the brain's learning algorithms and potential applications in AI.