介质的多巴胺释放的价值驱动的适应受到基于模型和无模型机制的控制
Rhiannon Robke1,2, Tara Arbab1,2, Rachel Smith1
1The Netherlands Institute for Neuroscience, Royal Netherlands Academy of Arts and Sciences, Amsterdam 1105BA, The Netherlands.
eNeuro
|June 25, 2024
概括
当奖励值发生变化时,多巴胺信号以不同的方式适应. 条件刺激多巴胺迅速减少并恢复,而奖励多巴胺保持稳定,表明结合式学习机制.
科学领域:
- 神经科学是一个神经科学.
- 行为科学 行为科学
- 强化学习是一种强化学习.
背景情况:
- 多巴胺信号编码奖励价值,对学习至关重要.
- 对多巴胺信号适应不断变化的奖励值进行了辩论,这对强化学习模型有影响.
研究的目的:
- 调查核中多巴胺信号如何适应奖励值.
- 为了确定多巴胺信号适应是否与无模型或基于模型的强化学习保持一致.
主要方法:
- 雄性老鼠被训练在帕夫洛夫的条件化范式.
- 在奖励值 (感官特异性或非特异性和感觉) 之前和之后,测量了多巴胺释放在核心核中.
- 评估了受条件刺激 (CS) 诱导的和不受条件刺激 (食物奖励) 诱导的多巴胺释放.
主要成果:
- 奖励值迅速减少了CS诱导的多巴胺释放,不管是值类型还是进一步的CS-奖励配对.
- 食物奖励诱导的多巴胺释放是抗值的.
- 值后的康复迅速恢复了CS诱导的多巴胺信号.
结论:
- 中层多巴胺信号表现出不同的适应:CS多巴胺显示出可能与基于模型的学习相关的快速,可逆的变化,而奖励多巴胺是稳定的,表明无模型的控制.
- 这些发现意味着多巴胺信号整合了无模型和基于模型的强化学习机制.
- 通过奖励多巴胺快速恢复CS多巴胺表明无模型和基于模型的过程之间存在潜在的相互作用.
相关概念视频
Drug Abuse and Addiction: Pharmacological Phenomena
464
Drug dependence, abuse, and addiction are complex phenomena that can precipitate various abnormal states. Physical dependence refers to a state of pharmacological adaptation to a drug. This adaptation often results in tolerance—a reduced response to the drug after repeated administrations. When the drug use is abruptly stopped, withdrawal symptoms occur due to the body's need to readjust from the pharmacologically induced imbalance. However, tolerance and withdrawal symptoms do not...
464
Drugs Affecting Neurotransmitter Synthesis
1.4K
Drugs affecting neurotransmitter synthesis can impact the adrenergic neuron and the synthesis of neurotransmitters. For example, α-methyltyrosine and carbidopa target specific enzymes involved in catecholamine synthesis. α-methyltyrosine inhibits the enzyme tyrosine hydroxylase, which converts tyrosine into dopamine. By blocking this enzyme, α-methyltyrosine reduces dopamine production and other catecholamines. Carbidopa, on the other hand, inhibits the enzyme dopa decarboxylase,...
1.4K
Adrenergic Agonists: Indirect-Acting Agents
1.6K
Indirect-acting adrenergic agonists potentiate the effects of endogenous catecholamines through different mechanisms without directly binding to adrenoceptors.
One mechanism involves depleting stored catecholamines by displacing them from synaptic vesicles. These agents, known as "displacers," are transported into vesicles at the expense of noradrenaline. Examples include amphetamine and tyramine, which lack a catechol moiety, resulting in prolonged action, improved oral...
One mechanism involves depleting stored catecholamines by displacing them from synaptic vesicles. These agents, known as "displacers," are transported into vesicles at the expense of noradrenaline. Examples include amphetamine and tyramine, which lack a catechol moiety, resulting in prolonged action, improved oral...
1.6K
Mechanistic Models: Overview of Compartment Models
80
Mechanistic models, a category encompassing both physiological and compartmental modeling, differ from empirical models' approaches to incorporating known factors about the systems being modeled. Empirical models describe data with minimal assumptions, while mechanistic models aim to provide a robust description of available data by specifying assumptions and integrating known factors about the system. Compartmental analysis is a key example of a mechanistic model in pharmacokinetics and...
80


