多巴胺建立并揭示与奖励相关的潜在行为吸引力
Jérémie Naudé1,2, Matthieu X B Sarazin3, Sarah Mondoloni4
1Sorbonne Université, Inserm, CNRS, Neuroscience Paris Seine; Institut de Biologie Paris Seine (NPS - IBPS), Paris, France. jeremie.naude@igf.cnrs.fr.
Nature communications
|November 13, 2024
概括
多巴胺是一种多巴胺.
科学领域:
- 神经科学是一个神经科学.
- 计算神经科学是一种神经科学.
- 动物行为 动物行为
背景情况:
- 阶段性多巴胺信号传统上被视为强化学习的"教学"信号.
- 然而,多巴胺也会产生激励性神经调节效应,影响行为.
- 解释这两个角色的统一原则仍然难以捉摸.
研究的目的:
- 阐明一个神经动力学原理,统一多巴胺的教学和激励作用.
- 引入MAGNet模型,用于决策的循环网络架构.
- 研究多巴胺如何在行动感知循环中塑造目标导向行为.
主要方法:
- 开发了MAGNet模型,这是一个包含动作感知循环的循环网络.
- 利用计算建模来模拟多巴胺对网络动态和吸引子形成的影响.
- 在小鼠中使用光遗传学调节来实验验验证模型预测.
主要成果:
- 多巴胺依赖的突触可塑性产生了代表内部目标的"潜伏"吸引物.
- 多巴胺调节的兴奋能力扩大了吸引力盆地,使全球目标可访问.
- 光遗传性多巴胺操纵特别快速地吸引小鼠到奖励的位置,没有运动副作用.
结论:
- 提出多巴胺在行为格局中揭示了多巴胺构建的吸引力.
- 这种机制统一了多巴胺在强化学习和动机中的作用.
- MAGNet模型为了解多巴胺对目标导向决策的影响提供了一个框架.
相关概念视频
Purposive Learning
99
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
99
Instinctive Drift
188
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
188
Behaviorism
2.2K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
2.2K
Drug Abuse and Addiction: Pharmacological Phenomena
444
Drug dependence, abuse, and addiction are complex phenomena that can precipitate various abnormal states. Physical dependence refers to a state of pharmacological adaptation to a drug. This adaptation often results in tolerance—a reduced response to the drug after repeated administrations. When the drug use is abruptly stopped, withdrawal symptoms occur due to the body's need to readjust from the pharmacologically induced imbalance. However, tolerance and withdrawal symptoms do not...
444
Law of Effect
1.3K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.3K
Incentive Theory: Pull Theory of Motivation
378
Incentive theory, or the "pull theory" of motivation, suggests that external rewards primarily drive behavior. Individuals are motivated to engage in activities when they anticipate a desirable outcome. This is why people often work hard for promotions or study intensively to achieve high grades. These incentives can be tangible, physical rewards such as money or promotions, or intangible, non-physical rewards like praise and social recognition.
The theory differentiates between...
The theory differentiates between...
378


