在疼痛避免和寻求奖励期间,强化学习的个体差异的神经相关值
Thang M Le1, Takeyuki Oba2, Luke Couch3
1Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut 06519 thang.le@yale.edu.
eNeuro
|February 16, 2024
概括
这项研究揭示了与强化学习 (RL) 个体差异相关的大脑区域. 我们发现了寻求奖励与避免痛苦的独特神经模式,澄清了我们如何从结果中学习.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 计算精神病学是一种计算精神病学.
背景情况:
- 强化学习 (RL) 解释了生物如何从行动结果关联中学习,以寻求奖励和避免惩罚.
- 已知RL指标的个体差异,如学习率和行动偏差,但它们的神经支不清楚.
- 了解这些神经相关性对于解释学习和决策的变化至关重要.
研究的目的:
- 在强化学习过程中识别计算过程中的个体差异的神经相关性.
- 调查大脑如何表示学习速度,行动偏差,帕夫洛夫因子和主观结果影响等指标.
- 为了比较奖励寻求过程中的神经活动与避免疼痛的学习.
主要方法:
- 在健康的人类参与者中使用功能磁共振成像 (fMRI).
- 采用概率学习的去/不去任务来评估寻求奖励和避免痛苦.
- 分析了学习速度,动作偏差,帕夫洛夫因子和主观结果影响的行为数据.
主要成果:
- 在行为上,与寻求奖励相比,在避免疼痛期间观察到更高的学习率.
- 脊前环状皮质,中环状皮质和中后环状皮质的神经活动与避免期间的学习速度和准确性相关.
- 特定的大脑区域,包括前中心,上额 (SFG),补充运动区域 (SMA),前SMA和后带带皮层,与不同的RL指标相关.
结论:
- 这项研究提供了强化学习计算过程中个体差异的第一个神经特征.
- 不同的神经基质是学习的不同方面的基础,包括学习速度,行动偏差和主观结果评估.
- 研究结果提供了关于适应性学习和决策过程中个体变化的神经基础的见解.
相关概念视频
01:24Primary Motives: Sleep, Sex, and Pain Avoidance
611
Primary motives such as sleep, sex, and pain avoidance are crucial drivers of behavior in humans and animals. These motives ensure survival, reproductive success, and overall well-being by prompting actions that meet essential bodily needs.
Sleep is a fundamental physiological drive that fosters a state of restfulness crucial for several bodily functions. It facilitates body restoration, the process by which the body repairs, rejuvenates, and maintains itself during sleep, including memory...
Sleep is a fundamental physiological drive that fosters a state of restfulness crucial for several bodily functions. It facilitates body restoration, the process by which the body repairs, rejuvenates, and maintains itself during sleep, including memory...
611
01:08Timing and Consequences on Behavior
94
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
94
01:14Avoidance Learning and Learned Helplessness
1.7K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.7K
01:25Analgesia and Pain Management
623
Pain is critical to various clinical pathologies, provoking an urgent need for effective management. Pain, whether acute or chronic, is a complex neurochemical process. Its alleviation depends on the type, with nonopioid analgesics effective for mild to moderate pain, such as musculoskeletal or inflammatory pain, while neuropathic pain responds best to anticonvulsants, tricyclic antidepressants, or serotonin/norepinephrine reuptake inhibitors. For severe acute or chronic pain, opioids may be...
623