作为行动支付对价值学习的影响基础的计算和神经机制
Sanghyun Yi1, John P O'Doherty2
1Division of the Humanities and Social Sciences, California Institute of Technology, 1200 E California Blvd, Pasadena, 91125, CA, USA. syi@caltech.edu.
Nature communications
|January 8, 2026
概括
行动负担能力和基于价值的学习共同工作,以指导在新情况下的选择. 一个动态的元控制器,涉及大脑区域,如前补充运动区域,平衡这些系统,以有效的行动选择.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 计算神经科学是一种神经科学.
背景情况:
- 智能代理必须在新环境中识别有益的行动.
- 行动负担能力是缩小行动选择的拟议机制.
- 了解负担能力和基于价值的学习之间的相互作用对于决策至关重要.
研究的目的:
- 研究在新环境中的基于价值的学习中,行动能力的神经计算机制.
- 为了确定是否行动负担能力偏向基于价值的选择或作为一个并发系统运行.
- 阐明控制行动选择的元控制的神经基础.
主要方法:
- 开发一种新的行为任务来研究行动能力和学习.
- 人类行为数据的计算建模.
- 功能磁共振成像 (fMRI) 数据的分析,以确定神经相关性.
主要成果:
- 行动支付功能作为一个独立的系统,与基于价值的决策并行运行.
- 在行动选择的负担能力和价值体系之间发生了竞争性相互作用.
- 超控制,涉及前补充运动区域和前带膜皮层,动态调节这些系统.
- 后壁状皮质整合了来自两个系统的信息,以指导最终的行动选择.
结论:
- 行动负担能力和基于价值的学习是不同的,但在新环境中相互作用的系统.
- 动态元控制机制平衡了负担能力和价值,以优化行动选择.
- 神经区域包括前补充运动区域,前带状皮质和后壁皮质对于这个过程至关重要.
相关概念视频
Cognitive Learning
997
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
997
Purposive Learning
435
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
435
Law of Effect
2.5K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
2.5K
Behaviorism
4.3K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
4.3K
Avoidance Learning and Learned Helplessness
2.5K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
2.5K
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K


