Jove
Visualize
联系我们
JoVE
x logofacebook logolinkedin logoyoutube logo
关于 JoVE
概览领导团队博客JoVE 帮助中心
作者
出版流程编辑委员会范围与政策同行评审常见问题投稿
图书馆员
用户评价订阅访问资源图书馆顾问委员会常见问题
研究
JoVE JournalMethods CollectionsJoVE Encyclopedia of Experiments存档
教育
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab Manual教师资源中心教师网站
使用条款与条件
隐私政策
政策

相关概念视频

Neural Regulation01:37

Neural Regulation

Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.

您也可能阅读

相关文章

通过共同作者、期刊和引用图与本文相关的文章。

排序
Same author

The Effect of Reward Magnitude on Different Types of Exploration in Human Reinforcement Learning.

Computational brain & behavior·2026
Same author

State Optimism as a State-Dependent Prior About Rewarding Outcomes.

Computational brain & behavior·2026
Same author

Sustained activity of human substantia nigra neurons reflect prior rewards.

iScience·2026
Same author

Mesocorticostriatal Reinforcement Learning of State Representation and Value with Implications for the Mechanisms of Schizophrenia.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2026
Same author

Identification of Mfa5-2 as a structural component of Mfa1 fimbriae in Porphyromonas gingivalis.

Journal of oral biosciences·2026
Same author

Dopamine and serotonin transients predict depressive symptom relief following deep brain stimulation of human subcallosal cingulate cortex.

bioRxiv : the preprint server for biology·2026

相关实验视频

Updated: May 7, 2026

Presynaptic Dopamine Dynamics in Striatal Brain Slices with Fast-scan Cyclic Voltammetry
08:49

Presynaptic Dopamine Dynamics in Striatal Brain Slices with Fast-scan Cyclic Voltammetry

Published on: January 12, 2012

22.1K

价值衰减的状梯度解释了多巴胺模式和强化学习计算的区域差异.

Ayaka Kato1,2, Kenji Morita3,4

  • 1Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, New York 10029-5674.

The Journal of neuroscience : the official journal of the Society for Neuroscience
|July 18, 2025
PubMed
概括

突触可塑性的值衰减解释了强化学习 (RL) 中异质多巴胺信号. 这种机制统一了在不同大脑区域和RL算法中观察到的多种多巴胺模式,表明渐变调节计算.

关键词:
这是一种计算式计算.腐烂衰变是一种多巴胺是多巴胺的一种.忘记是一种忘记.升降坡道的升降坡道.强化学习是一种强化学习.

更多相关视频

Comprehensive Profiling of Dopamine Regulation in Substantia Nigra and Ventral Tegmental Area
09:54

Comprehensive Profiling of Dopamine Regulation in Substantia Nigra and Ventral Tegmental Area

Published on: August 10, 2012

26.0K
Modeling Fast-scan Cyclic Voltammetry Data from Electrically Stimulated Dopamine Neurotransmission Data Using QNsim1.0
07:41

Modeling Fast-scan Cyclic Voltammetry Data from Electrically Stimulated Dopamine Neurotransmission Data Using QNsim1.0

Published on: June 5, 2017

10.0K

相关实验视频

Last Updated: May 7, 2026

Presynaptic Dopamine Dynamics in Striatal Brain Slices with Fast-scan Cyclic Voltammetry
08:49

Presynaptic Dopamine Dynamics in Striatal Brain Slices with Fast-scan Cyclic Voltammetry

Published on: January 12, 2012

22.1K
Comprehensive Profiling of Dopamine Regulation in Substantia Nigra and Ventral Tegmental Area
09:54

Comprehensive Profiling of Dopamine Regulation in Substantia Nigra and Ventral Tegmental Area

Published on: August 10, 2012

26.0K
Modeling Fast-scan Cyclic Voltammetry Data from Electrically Stimulated Dopamine Neurotransmission Data Using QNsim1.0
07:41

Modeling Fast-scan Cyclic Voltammetry Data from Electrically Stimulated Dopamine Neurotransmission Data Using QNsim1.0

Published on: June 5, 2017

10.0K

科学领域:

  • 计算神经科学是一种神经科学.
  • 强化学习的学习理论
  • 多巴胺的神经生物学

背景情况:

  • 多巴胺在奖励预测错误 (RPE) 中的作用受到争论,在大脑区域和条件中观察到异质的模式.
  • 现有的强化学习 (RL) 理论难以调和这些多样化的多巴胺信号模式.
  • 区域多巴胺异质性与各种RL算法之间的准确关系仍然难以捉摸.

研究的目的:

  • 展示如何将价值衰变纳入RL模型可以连贯地解释异构的多巴胺信号.
  • 将价值衰减与特定的RL算法联系起来,包括预测状态表示,层次RL和分布式RL.
  • 建议在条状体内有一个中侧到侧侧的价值梯度或突触衰变调整区域RL计算.

主要方法:

  • 开发了结合价值衰变的计算模型,表示突触可塑性衰变.
  • 分析了在不同状态表示下,价值衰减如何影响RPE信号.
  • 构建了具有和没有值衰减的等级和分布式RL模型,以模拟条形电路活动.

主要成果:

  • 价值衰退解释了在特定状态表示下升的RPE,并解释了色的多巴胺升和依赖暗示类型/间隔的模式.
  • 一个带有和没有价值衰变的合层次的RL模型成功地复制了不同的条状多巴胺电路活动模式.
  • 有和没有值衰变的分布式RL模型阐明了区域多巴胺模式如何与分布式编码强度相关.

结论:

  • 通过突触可塑性实现的价值衰减,为理解RL中的多种多巴胺RPE信号提供了一个统一的框架.
  • 状体内值或突触衰变的梯度可以通过调节多巴胺/RPE信号来调整区域RL计算.
  • 该框架将区域多巴胺异质性与不同的RL算法相协调,为灵活的学习和习惯形成提供了洞察力.