核 accumbens 多巴胺释放反映了贝叶斯推理在仪器学习期间的贝叶斯推理
Albert J Qü1,2, Lung-Hao Tai3, Christopher D Hall4
1Department of Psychology, University of California, Berkeley, CA, 94720, USA.
bioRxiv : the preprint server for biology
|November 28, 2023
概括
小鼠使用概率学信念来做出决策,这是一项双臂强盗任务. 核突中的多巴胺信号反映了这些信念,支持其在强化学习中的作用.
科学领域:
- 神经科学是一个神经科学.
- 计算神经科学是一种神经科学.
- 行为神经科学 行为神经科学
背景情况:
- 理论上,核突中的多巴胺释放信号奖励预测错误,对于强化学习至关重要.
- 了解大脑对感官信息的映射以奖励预测至关重要,尤其是在模两可的环境线索的情况下.
研究的目的:
- 调查概率学信仰如何影响仪器任务执行和多巴胺信号传递.
- 测试核中多巴胺释放是否反映了贝叶斯对环境隐藏状态的信念的更新.
主要方法:
- 鼠标执行了一个双臂强盗任务,重复切换隐藏状态.
- 选择行为被记录下来,同时在核中释放多巴胺,使用dLight信号.
- 用行为数据比较认知模型,以确定最适合的信念计算策略.
主要成果:
- 行为数据强烈支持采用贝叶斯更新概率学信念的模型,而不是非贝叶斯替代方案.
- 同样的贝叶斯模型提供了一个优越的定量匹配记录的多巴胺测量.
- 这表明概率学信念计算是任务执行的组成部分,并反映在多巴胺信号中.
结论:
- 概率学信念计算在小鼠的仪器学习和决策中发挥着重要作用.
- 原子核中的中层多巴胺信号似乎反映了这些潜在的概率计算.
- 这些发现支持一种模型,其中多巴胺信号整合了适应性行为的信念更新.
相关概念视频
Associative Learning
404
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
404
Instinctive Drift
228
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
228


