超强化学习在前带带皮层中协调了惊喜,价值和控制
Tim Vriens1, Eliana Vassena2,3, Giovanni Pezzulo1
1Institute of Cognitive Sciences and Technologies, CNR, Rome, Italy.
PLoS computational biology
|April 22, 2025
概括
脊前环状皮层 (dACC) 通过超学习优化认知控制,整合惊喜跟踪和性能监测功能. 这个新的框架解决了关于dACC的辩论.
科学领域:
- 神经科学是一个神经科学.
- 认知神经科学 认知神经科学
- 计算神经科学是一种神经科学.
背景情况:
- 背前环状皮层 (dACC) 在认知中的作用受到辩论,理论集中在认知控制或监测上.
- 现有研究提出了相互矛盾的发现,创造了关于dACC功能的理论局.
- 目前的模型无法将dACC参与的意外跟踪和认知控制任务相协调.
研究的目的:
- 为dACC功能提出一个统一的假设,整合认知控制和监测观点.
- 引入一个超强化学习框架,其中通过基于贝叶斯惊喜的超学习优化认知控制.
- 解决认知神经科学中dACC功能周围的理论危机.
主要方法:
- 开发一个新的dACC功能的meta-Reinforcement学习假设.
- 使用三个功能神经成像实验测试假设的定量预测.
- 分析神经成像数据以评估框架解释DACC激活模式的能力.
主要成果:
- 超强化学习框架成功预测了dACC在认知控制和监测任务中的激活.
- 拟议的模型协调了dACC文献中以前相互矛盾的发现.
- 贝叶斯惊喜跟踪被确定为通过meta-learning优化认知控制的关键机制.
结论:
- dACC功能可以被理解为认知控制的超学习优化.
- 超强化学习框架为dACC在认知控制,惊喜跟踪和绩效监测中的作用提供了整合性视角.
- 这项研究为关于dACC函数的长期理论危机提供了解决方案.
更多相关视频
09:00Investigating the Function of Deep Cortical and Subcortical Structures Using Stereotactic Electroencephalography: Lessons from the Anterior Cingulate Cortex
Published on: April 15, 2015
12.2K
09:01The Double-H Maze: A Robust Behavioral Test for Learning and Memory in Rodents
Published on: July 8, 2015
12.4K
相关概念视频
01:21Cognitive Learning
94
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
94
01:23Reinforcement
152
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
152