人类大脑中的基于模型和无模型的估值信号在与行为控制中的个体差异的关系上有明显的不同
Weilun Ding1, Jeffrey Cockburn1,2, Julia Pia Simon1
1Division of Humanities & Social Sciences, California Institute of Technology, Pasadena, CA, USA.
bioRxiv : the preprint server for biology
|September 26, 2025
概括
人类行动选择使用无模型和基于模型的强化学习. 大脑活动的个体差异表明,基于模型的信号仅在行为使用时才出现,与无处不在的无模型信号不同.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 计算精神病学是一种计算精神病学.
背景情况:
- 人类决策涉及无模型和基于模型的强化学习策略.
- 这些策略的神经基础中的个体差异仍然不太了解.
- 连续的决策任务往往显示出两种行为策略的混合.
研究的目的:
- 在无模型和基于模型的强化学习中研究个体差异的神经基础.
- 澄清大脑如何编码与战略使用相关的价值信号.
- 确定不同学习策略中奖励预测错误的神经基础.
主要方法:
- 大规模的fMRI研究,其中179名参与者执行了两步任务.
- 使用集群定义的子组和计算参数估计的分析.
- 检查了腹中前额叶皮层,腹上条纹体和中尾状体中的神经信号.
主要成果:
- 风中介前额叶皮层根据个体策略依赖差异化编码基于模型和无模型的价值信号.
- 基于模型的价值信号与基于行为模型的依赖相相关;不依赖模型的信号存在,而不考虑行为影响.
- 腹腔条状体预测错误活动与基于模型的计算保持一致,而中尾状体活动与无模型学习保持一致.
结论:
- 无模型学习信号是普遍存在的,不管行为策略如何.
- 基于模型的神经表示是针对表现出基于模型的行为个体的.
- 基于模型的行为缺陷可能源于形成准确的环境预测的困难.
相关概念视频
Self-Regulation
223
Self-regulation, also known as self-control, encompasses a range of cognitive and behavioral processes that allow individuals to adjust their internal states and outward actions to align with socially acceptable norms and long-term goals. It plays a fundamental role in adaptive functioning, from resisting impulsive behaviors to persisting through challenging tasks. While its benefits are widely recognized, self-regulation is not limitless. Muraven and Baumeister's theory posits that...
223
Behavioral Genetics and Its Designs
1.0K
Behavior genetics explores how genetic inheritance influences human behavior. It focuses on how genes, passed from parents to offspring, contribute to the development of behavioral traits and tendencies. This branch of genetics seeks to understand the complex interplay between inherited genetic factors and environmental influences in shaping our behaviors.
The primary methodologies used in behavior genetics include family studies, twin studies, and adoption studies, each providing unique...
The primary methodologies used in behavior genetics include family studies, twin studies, and adoption studies, each providing unique...
1.0K
The Behavioral Perspective on Personality
793
Behaviorists view personality as primarily shaped by environmental reinforcements and consequences. According to this perspective, behavior is influenced by external stimuli, and individuals adjust their actions based on rewards and punishments. Over time, learning histories — accumulated patterns of reinforcement — play a significant role in shaping personality. Behaviors that lead to positive outcomes are reinforced, while those resulting in negative outcomes are diminished.
793


