在横向前额叶皮质中对目标和不确定性进行因子化嵌入,引导稳定灵活的学习
Yoondo Sung1, Mattia Rigotti2, Sang Wan Lee3,4,5,6,7
1Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea.
Nature communications
|November 26, 2025
概括
适应性代理面临着灵活性-稳定性困境. 基于模型的学习和前额叶皮层的因子化神经嵌入使得在不确定的环境中能够实现稳定,灵活的目标导向行为.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 人工智能的人工智能
背景情况:
- 适应性代理需要行为灵活性和稳定性,特别是在不确定性下的目标导向学习中.
- 平衡适应不断变化的目标的能力与对噪音信号的弹性,对于代理的性能至关重要.
- 导航这种灵活性-稳定性权衡的大脑机制仍然是一个活跃的研究领域.
研究的目的:
- 研究大脑如何在不确定的环境中在目标导向学习期间平衡行为灵活性和稳定性.
- 为了比较无模型与基于模型的学习策略在解决灵活性-稳定性困境方面的表现.
- 识别灵活和稳定的目标导向行为的神经支柱.
主要方法:
- 结合计算模型模拟与人类行为和fMRI数据.
- 设计了一个以目标为导向的学习任务,具有不同的环境不确定性.
- 在横向前额和轨道前额皮层中分析了目标和不确定性的神经表示.
主要成果:
- 基于模型的学习与灵活性-稳定性权衡作斗争,而基于模型的学习则表现出更好的适应性.
- 人类参与者表现出稳定和灵活的目标导向行为.
- 确定了目标和不确定性的因素化嵌入在横向前额叶和轨道前额叶皮质中.
- 神经分离能力和弹性与行为灵活性和稳定性相关.
结论:
- 基于模型的学习为实现行为灵活性与稳定性提供了一个框架.
- 侧面前额和轨道前额皮层以因子化方式编码目标和不确定性,支持适应性行为.
- 这些区域的神经表征对于在不确定的环境中导航灵活性-稳定性权衡至关重要.
相关概念视频
01:14Avoidance Learning and Learned Helplessness
2.5K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
2.5K
01:12Observational Learning
802
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
802
01:21Cognitive Learning
981
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
981
01:22Purposive Learning
426
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
426
01:27Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
01:16Statically Indeterminate Problem Solving
671
Statically indeterminate problems are those where statics alone can not determine the internal forces or reactions. Consider a structure comprising two cylindrical rods made of steel and brass. These rods are joined at point B and restrained by rigid supports at points A and C. Now, the reactions at points A and C and the deflection at point B are to be determined. This rod structure is classified as statically indeterminate as the structure has more supports than are necessary for maintaining...
671