双重信用分配过程是复杂空间环境中多巴胺信号的基础
Timothy A Krausz1, Alison E Comrie1, Ari E Kahn2
1Neuroscience Graduate Program, University of California, San Francisco, San Francisco, CA 94158, USA.
Neuron
|August 23, 2023
概括
大鼠的多巴胺信号揭示了大脑如何更新不同位置的价值估计. 这些信号支持多个学习算法,增强复杂环境中的决策.
科学领域:
- 神经科学是一个神经科学.
- 计算神经科学是一种神经科学.
- 动物行为 动物行为
背景情况:
- 动物根据预期的未来奖励或价值观做出决定.
- 大脑根据经验更新这些值,但信用分配算法尚不清楚.
研究的目的:
- 为了调查accumbens多巴胺在更新基于价值的决策中的作用.
- 识别大脑在自然环境中用于信用分配的学习算法.
主要方法:
- 监测在复杂,动态的环境中寻找食物的老鼠中的多巴胺水平.
- 分析多巴胺信号与奖励接收,新的路径机会和向奖励位置的移动有关.
主要成果:
- 多巴胺脉冲发生在收到奖励时 (与预测误差进行缩放) 和在新的路径选择时.
- 多巴胺水平向奖励端口上升,与位置值成比例.
- 通过渐进路径传播和基于内部模型的推断,发现了价值更新的证据.
结论:
- 在复杂的环境中,accumbens 多巴胺信号传递特定位置的值.
- 基于多巴胺的值更新使用多种互补的学习算法,包括时间差异学习和基于模型的推断.
相关概念视频
Neurochemical Transmission: Sites of Drug Action
2.5K
Neurochemical transmission, the conduction of electrical impulses between neurons mediated by neurotransmitters, plays a vital role in various physiological processes. Autonomic drugs exert their effects by modulating neurotransmission within the autonomic nervous system. For instance, drugs such as hemicholinium block the precursor uptake necessary for synthesizing acetylcholine, an essential autonomic neurotransmitter. Following synthesis, neurotransmitters are stored in vesicles. Metyrosine...
2.5K
Diencephalon: Thalamus and Information Relay
1.7K
The thalamus, often called “the gateway to the cerebral cortex,” is vital in processing and directing sensory and motor signals throughout the brain. Almost all inputs destined for the cerebral cortex, except for olfactory signals, are relayed through the thalamus. The thalamus is a sophisticated relay station, channeling information from various brain regions to the cerebral cortex, as well as a filter, prioritizing certain signals over others based on current physiological...
1.7K


