混合神经认知模型揭示了记忆如何塑造人类的学习奖励
Maria K Eckstein1, Christopher Summerfield2, Nathaniel D Daw3,4
1Google DeepMind, London, UK. mariaeckstein@google.com.
Nature human behaviour
|February 5, 2026
概括
这项研究挑战了传统的强化学习 (RL) 模型,表明人类的奖励学习需要灵活的记忆,而不仅仅是简单的增量更新. 成功的模型使用丰富的过去表示来指导未来的行为.
科学领域:
- 认知心理学 认知心理学
- 神经科学是一个神经科学.
- 计算建模 计算建模
背景情况:
- 了解过去的经历如何塑造未来的行为是心理学和神经科学的关键挑战.
- 奖励导向学习通常使用强化学习 (RL) 算法来解释,这些算法依赖于逐渐更新的内部变量.
- 现有的RL模型可能过度简化了人类奖励学习的复杂机制.
研究的目的:
- 在人类奖励学习中研究受欢迎的强化学习模型的假设.
- 开发和测试一种混合建模方法,整合人工神经网络和认知架构.
- 确定必要和足够的组件来准确建模人类以奖励为指导的行为.
主要方法:
- 采用混合建模方法,将人工神经网络与可解释的认知架构结合起来.
- 算法组件以最一般的形式进行估计,并系统地评估它们的必要性/充分性.
- 该方法应用于人类奖励学习行为的大量数据集.
主要成果:
- 成功的模型需要独立和灵活的记忆变量,能够跟踪过去经验的丰富表示.
- 这些发现表明,人类的奖励学习不仅仅是基于逐渐更新标量奖励预测.
- 一类基于增量更新的流行的RL模型受到质疑.
结论:
- 人类的奖励学习依赖于比许多RL模型先前假设的更复杂的记忆机制.
- 综合ANN和认知架构的混合建模方法为理解学习提供了强大的工具.
- 未来的研究应该考虑灵活和丰富的记忆表征在建模奖励导向行为时.
更多相关视频
10:42A Lateralized Odor Learning Model in Neonatal Rats for Dissecting Neural Circuitry Underpinning Memory Formation
Published on: August 18, 2014
9.4K
08:35Shuttle Box Assay as an Associative Learning Tool for Cognitive Assessment in Learning and Memory Studies using Adult Zebrafish
Published on: July 12, 2021
5.0K
相关概念视频
01:21Cognitive Learning
1.2K
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
1.2K
01:26Higher Mental Functions of Brain: Learning and Memory
2.1K
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
2.1K
01:38Cognitive Dissonance
37.5K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
37.5K
03:24Hybridization of Atomic Orbitals I
67.6K
The mathematical expression known as the wave function, ψ, contains information about each orbital and the wavelike properties of electrons in an isolated atom. When atoms are bound together in a molecule, the wave functions combine to produce new mathematical descriptions that have different shapes. This process of combining the wave functions for atomic orbitals is called hybridization and is mathematically accomplished by the linear combination of atomic orbitals. The new orbitals that...
67.6K
03:35Hybridization of Atomic Orbitals II
49.2K
sp3d and sp3d 2 Hybridization
49.2K
02:52VSEPR Theory and the Basic Shapes
85.2K
Overview of VSEPR Theory
85.2K