核 accumbens 多巴胺释放反映了贝叶斯推理在仪器学习期间的贝叶斯推理
Albert J Qü1,2, Lung-Hao Tai3, Christopher D Hall4
1Department of Psychology, University of California, Berkeley, Berkeley, California, United States of America.
PLoS computational biology
|July 2, 2025
概括
在大脑中释放多巴胺.
科学领域:
- 神经科学是一个神经科学.
- 计算神经科学是一种神经科学.
- 行为神经科学 行为神经科学
背景情况:
- 理论上,核突中的多巴胺释放代表了奖励预测错误,这是强化学习的一个关键概念.
- 了解大脑如何绘制感官信息来奖励预测至关重要,但仍然不完整,尤其是含糊不清的环境线索.
研究的目的:
- 调查小鼠的多巴胺信号是否反映了仪器学习任务期间的概率学信念更新.
- 为了测试多巴胺释放取决于大脑对环境隐藏状态的不断发展的信念的假设.
主要方法:
- 鼠标执行了一个双臂强盗任务,使用一个随机切换隐藏状态.
- 行为选择被记录下来,以及使用dLight成像在核 accumbens中释放多巴胺.
- 包括贝叶斯和非贝叶斯方法在内的认知模型与行为和神经数据进行了比较.
主要成果:
- 行为数据分析倾向于使用贝叶斯式更新概率学信念的计算模型.
- 这些贝叶斯模型还提供了与非贝叶斯模型相比,对测量的半边际多巴胺 (dLight) 信号的优越量化适应.
- 这些发现表明,概率学信念计算是仪器任务执行的组成部分,并反映在多巴胺信号中.
结论:
- 在小鼠中,中层多巴胺信号反映了对环境状态的概率学信念的计算.
- 这项研究提供了强化学习的生物学基础的证据,其中多巴胺信号与贝叶斯推理有关.
- 结果强调了概率学信念更新在工具决策及其神经相关的作用.
相关概念视频
01:12Observational Learning
319
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
319
01:21Operant Conditioning
1.8K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
1.8K
01:27Associative Learning
597
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
597
01:05Instinctive Drift
330
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
330
01:27Diencephalon: Thalamus and Information Relay
2.3K
The thalamus, often called “the gateway to the cerebral cortex,” is vital in processing and directing sensory and motor signals throughout the brain. Almost all inputs destined for the cerebral cortex, except for olfactory signals, are relayed through the thalamus. The thalamus is a sophisticated relay station, channeling information from various brain regions to the cerebral cortex, as well as a filter, prioritizing certain signals over others based on current physiological...
2.3K
01:24Operant Conditioning Intervention
123
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...
123