政策复杂性抑制了多巴胺反应
Samuel J Gershman1, Armin Lak2
1Department of Psychology and Center for Brain Science, Harvard University, Cambridge, Massachusetts 02138 gershman@fas.harvard.edu.
概括
通过简化他们的决策策略 (政策复杂性),小鼠在感知任务上表现近乎最佳. 这个大脑机制,可能涉及多巴胺,平衡性能与认知负载,塑造强化学习.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 计算生物学 计算生物学
背景情况:
- 信息处理能力是任务执行的基本限制.
- 了解大脑如何在这些范围内优化行为至关重要.
研究的目的:
- 为了研究动物如何在感知决策任务中实现接近最佳的性能,尽管能力有限.
- 探索政策复杂性和强化学习机制在塑造行为中的作用.
主要方法:
- 在感知决策任务期间,在雄性和雌性小鼠中测量了政策复杂性 (状态和行为之间的相互信息).
- 研究了强化学习与政策复杂性处罚的潜在作用.
- 检查了中脑对奖励结果的多巴胺反应及其与政策复杂性的关系.
- 相关的神经和行为奖励灵敏度.
主要成果:
- 鼠标相对于其信息处理能力的极限,实现了近乎最佳的性能.
- 发现政策复杂性抑制中脑多巴胺反应以奖励结果.
- 神经和行为奖励灵敏度在整个会议中显示出正相关性.
结论:
- 政策压缩,一种简化决策的策略,似乎塑造了大脑中强化学习的基本机制.
- 多巴胺信号可能在学习过程中在实施政策复杂性处罚方面发挥作用.
相关概念视频
01:29Drugs Affecting Neurotransmitter Synthesis
1.3K
Drugs affecting neurotransmitter synthesis can impact the adrenergic neuron and the synthesis of neurotransmitters. For example, α-methyltyrosine and carbidopa target specific enzymes involved in catecholamine synthesis. α-methyltyrosine inhibits the enzyme tyrosine hydroxylase, which converts tyrosine into dopamine. By blocking this enzyme, α-methyltyrosine reduces dopamine production and other catecholamines. Carbidopa, on the other hand, inhibits the enzyme dopa decarboxylase,...
1.3K
01:24Parkinson's Disease: Treatment
215
Neurodegenerative disorders, such as Parkinson's Disease (PD), involve the gradual and irreversible destruction of neurons in particular brain areas. These disorders exhibit standard features like proteinopathies, selective vulnerability of some neurons, and an interaction of intrinsic properties, genetics, and environmental influences in neural injury.
Parkinson's Disease is primarily a result of the loss of dopaminergic neurons in the substantia nigra pars compacta. The cornerstone of...
Parkinson's Disease is primarily a result of the loss of dopaminergic neurons in the substantia nigra pars compacta. The cornerstone of...
215
01:15Drug Abuse and Addiction: Pharmacological Phenomena
433
Drug dependence, abuse, and addiction are complex phenomena that can precipitate various abnormal states. Physical dependence refers to a state of pharmacological adaptation to a drug. This adaptation often results in tolerance—a reduced response to the drug after repeated administrations. When the drug use is abruptly stopped, withdrawal symptoms occur due to the body's need to readjust from the pharmacologically induced imbalance. However, tolerance and withdrawal symptoms do not...
433
01:20Desensitization and Tachyphylaxis
1.5K
Tachyphylaxis is described as a rapid decrease in response to a drug after repeated or continuous administration of the same drug dose. It is a phenomenon where the body becomes less responsive to a particular substance or intervention over time, requiring higher doses or stronger interventions to achieve the same effect. It results from adaptive changes in the body's receptors, signaling pathways, or physiological processes that occur in response to prolonged exposure to a stimulus.
1.5K
01:03Dose-Response Relationship: Overview
2.9K
Agonists can bind with and activate receptors, resulting in the formation of drug-receptor complexes. Once formed, these complexes catalyze many biochemical processes at the cellular level and subsequently induce a pharmacologic response. The degree of response is directly proportional to the fraction of activated receptors, which in turn, depends on the concentration of the drug at the receptor site as well as the sensitivity of the receptor. An increase in the administered dose contributes to...
2.9K
01:27Psychosis: Pathophysiology of Schizophrenia and Other Psychotic Disorders
427
Schizophrenia is a neurodevelopmental disorder whose origins are rooted in complex genetic components. Despite our burgeoning understanding, the pathophysiology of this disorder remains incompletely deciphered.
Researchers have identified genetic factors that increase susceptibility to schizophrenia, underscoring the intricate interplay between genetics and environment in disease development. At the core of schizophrenia's pathophysiology is excessive dopaminergic neurotransmission within...
Researchers have identified genetic factors that increase susceptibility to schizophrenia, underscoring the intricate interplay between genetics and environment in disease development. At the core of schizophrenia's pathophysiology is excessive dopaminergic neurotransmission within...
427