在前额头-状状网络中强化学习策略的thalamic调节
Bin A Wang1, Mien Brabeeba Wang2, Norman H Lam3
1School of Psychology, Center for Studies of Psychological Application, Guangdong Key Laboratory of Mental Health and Cognitive Science, Key Laboratory of Brain Cognition and Educational Science, Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Guangzhou, China.
Nature communications
|October 16, 2025
概括
中背丘脑 (MD) 在无模型和基于模型的强化学习 (RL) 策略之间进行仲裁. 前额头 - thalamic通路是灵活决策和RL中的上下文推断的关键.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 计算神经科学是一种神经科学.
背景情况:
- 人类决策依赖于无模型和基于模型的强化学习 (RL) 策略.
- 这些策略主要与前额前-状回路有关.
- 对于这些RL策略之间的精确神经机制仲裁仍然不完全理解.
研究的目的:
- 阐明中脊柱体 (MD) 在无模型和基于模型的RL策略之间调解的作用.
- 在策略选择过程中调查MD,前额叶皮层 (PFC) 和条纹体之间的功能连接.
- 在受损的上下文推理条件下,为无模型策略的出现建模计算基础.
主要方法:
- 功能磁共振成像 (fMRI) 与计算建模 (CogLinks) 结合在一个概率逆转学习任务中.
- 在不同的RL策略使用过程中分析了MD,背部PFC和条纹体中的神经活动模式.
- 利用fMRI解码分析来验证关于战略表示覆盖的计算模型预测.
主要成果:
- 确定了背部PFC (基于模型) 和条纹体 (无模型) 在支持规则切换中的不同角色.
- 证明横向和中间的MD分区分别采用基于模型和无模型的RL模式,分别具有不同的PFC连接.
- 发现在转向以模型为基础的更新时,前额前部的跨体处理增加,而在中间层面发生无模型更新.
- 该CogLinks模型揭示了无模型策略源于前额头 - thalamic上下文推断的失败,导致PFC表示的重写速度较慢.
结论:
- 中背丘脑 (MD) 在在无模型和基于模型的强化学习策略之间进行仲裁方面发挥着至关重要的作用.
- 前额外的跨体路径对于灵活的,基于RL的认知至关重要,特别是在上下文推断和战略更新方面.
- 在这些路径中受损的上下文推断可以导致无模型策略的出现和持久性.
相关概念视频
01:30Diencephalon: Anatomical Regions
The diencephalon, etymologically translated as 'through brain,' plays an integral role as the conduit between the cerebrum and the vast extent of the nervous system. However, the olfactory system is an exception, as it interfaces directly with the cerebrum. The diencephalon, deeply ensconced beneath the cerebrum, primarily consists of three paired structures — the thalamus, hypothalamus, and epithelamus. It also includes accessory structures such as the subthalamus, which houses the subthalamic...
01:27Diencephalon: Thalamus and Information Relay
The thalamus, often called “the gateway to the cerebral cortex,” is vital in processing and directing sensory and motor signals throughout the brain. Almost all inputs destined for the cerebral cortex, except for olfactory signals, are relayed through the thalamus. The thalamus is a sophisticated relay station, channeling information from various brain regions to the cerebral cortex, as well as a filter, prioritizing certain signals over others based on current physiological states or needs.