自然行为是通过多巴胺介导的强化学习的
Jonathan Kasdin1, Alison Duffy2, Nathan Nadler1
1Department of Neuroscience, Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA.
Nature
|March 13, 2025
概括
斑马的多巴胺指导声学,通过信号提高歌曲的准确性,类似于强化学习. 这表明基于多巴胺的强化学习是复杂的自然行为的基础.
科学领域:
- 神经科学
- 动物的行为
- 计算神经科学
背景情况:
- 像说话这样的自然运动技能是通过尝试和错误来学习的.
- 假设基底中的多巴胺通过编码奖励预测错误来指导这种学习.
- 之前的研究表明多巴胺编码成年斑马的性能预测错误.
研究的目的:
- 通过以多巴胺为基础的强化来研究幼斑鸟的发育声学.
- 在学习歌曲时监测X区域的多巴胺活性.
主要方法:
- 追踪小斑马的歌曲学习轨迹.
- 使用光纤测量来监测X区的多巴胺活性.
- 分析多巴胺活动与歌曲波动之间的关系.
主要成果:
- 在接近成人歌曲版本的音节之后, 多巴胺被激活, 在更远的音节之后被抑制.
- 多巴胺活动预测了未来的歌曲演变,
- 多巴胺活性与当前和近期歌曲的对比性相关,
结论:
- 年轻的斑马使用多巴胺介导的强化学习来获得声音.
- 多巴胺在编码预测错误中的作用似乎对复杂的自然行为学习至关重要.
- 强化学习模型可以解释生物系统中的自然行为.
相关概念视频
Behaviorism
2.2K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
2.2K
Operant Conditioning
1.5K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
1.5K
Law of Effect
1.3K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.3K
Operant Conditioning Intervention
33
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...
33
Timing and Consequences on Behavior
71
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
71
Instinctive Drift
173
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
173


