Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Search research articles

Related Experiment Videos

Dopamine: generalization and bonuses.

Sham Kakade¹, Peter Dayan

¹Gatsby Computational Neuroscience Unit, University College London, UK. sham@gatsby.ucl.ac.uk

Neural Networks : the Official Journal of the International Neural Network Society

|October 10, 2002

Summary

This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Latent subdimensions of anxiety and depression differentially influence exertion of effort in pursuit of reward versus avoidance of threat.

Translational psychiatry·2026

Same author

Neural signatures of model-based and model-free reinforcement learning across prefrontal cortex and striatum.

eLife·2026

Same author

Uncertainty for better and worse.

Current opinion in neurobiology·2026

Same author

Dopamine dynamics in human anterior cingulate cortex during Pavlovian-instrumental conflict.

bioRxiv : the preprint server for biology·2026

Same author

Modality-general sensitivity of pupil responses to regularity violations.

Cognitive, affective & behavioral neuroscience·2026

Same author

Metacognitive efficiency in learned value-based choice.

PLoS computational biology·2026

Same journal

Exploiting audio-visual modalities in videos: Object detection via multi-stage bilateral coupling network.

Neural networks : the official journal of the International Neural Network Society·2026

Same journal

Reliability-aware modality completion with cross-modal distillation for federated learning with missing modalities.

Neural networks : the official journal of the International Neural Network Society·2026

Same journal

IGFD-Net: Illumination-guided frequency decoupling for polarization image fusion.

Neural networks : the official journal of the International Neural Network Society·2026

Same journal

Multiple-Strategies dung beetle optimizer and its applications in engineering optimization and bankruptcy prediction.

Neural networks : the official journal of the International Neural Network Society·2026

Same journal

Aggregating global-scale pixel-wise forgery cues within a graph.

Neural networks : the official journal of the International Neural Network Society·2026

Same journal

Finite-Time intermittent control for secure synchronization of Neutral-Type stochastic delayed neural networks under aperiodic DoS attacks.

Neural networks : the official journal of the International Neural Network Society·2026

See all related articles

Primate dopamine neurons signal reward prediction errors. This study explains anomalies in dopamine cell activity related to generalization and novelty, proposing dopamine guides exploration.

Area of Science:

Neuroscience
Computational Neuroscience
Behavioral Neuroscience

Background:

The temporal difference model posits primate dopamine neurons signal reward prediction errors, supported by experimental data.
Anomalies exist where dopamine cell activity appears inconsistent with reward prediction error signaling.
These anomalies involve responses to stimuli not directly linked to reward predictions, particularly concerning generalization and novelty.

Purpose of the Study:

To address anomalies in dopamine neuron activity related to generalization and novelty.
To propose a revised understanding of dopamine neuron function beyond simple reward prediction errors.
To investigate the role of dopamine in guiding exploration.

Main Methods:

Theoretical modeling of dopamine neuron activity.

Related Experiment Videos

Analysis of experimental data on dopamine cell responses.

Interpretation of dopamine's role in generalization and novelty.

Main Results:

Generalization responses are explained as a consequence of partial information.
Novelty responses are attributed to dopamine neurons multiplexing information about various reward bonuses, including exploration and shaping bonuses.
Dopamine's role extends to guiding exploration through attentional and psychomotor effects.

Conclusions:

Dopamine neuron activity, while largely reflecting reward prediction errors, also accommodates generalization and novelty.
Dopamine neurons multiplex information, contributing to reward prediction and exploration guidance.
The computational role of dopamine involves guiding exploration via attentional and psychomotor mechanisms.