相关实验视频
Updated: Jan 11, 2026
12:09
Studying Food Reward and Motivation in Humans
Published on: March 19, 2014
24.1K
一个习惯和工作记忆模型作为人类基于奖励的学习的替代解释
1Department of Psychology, University of California, Berkeley, Berkeley, CA, USA. annecollins@berkeley.edu.
Nature human behaviour
|November 18, 2025
概括
强化学习 (RL) 模型可能无法完全解释人类的基于奖励的学习. 人类的学习涉及工作记忆和习惯形成,而不仅仅是标准的RL算法,这表明需要重新评估RL.
科学领域:
- 认知神经科学 认知神经科学
- 计算精神病学是一种计算精神病学.
- 行为经济学是一种行为经济学.
背景情况:
- 强化学习 (RL) 算法成功地模拟了跨物种的基于奖励的学习,并捕获了大脑信号变异.
- 人类基于奖励的学习涉及复杂的过程,如记忆和选择的坚持,这可能被错误地归因于RL.
- 现有的模型可能过于简化了人类仪器学习的基础的神经和认知机制.
研究的目的:
- 调查标准强化学习计算在多大程度上支持人类的基于奖励的学习行为.
- 从其他认知过程中解开RL的贡献,如工作记忆和习惯形成.
- 开发一个更准确的人类仪器学习的计算模型.
主要方法:
- 重新分析了7个不同的数据集,其中包括594名参与者.
- 对行为数据应用计算建模技术.
- 标准RL模型与结合工作记忆和关联式学习的替代模型的比较.
主要成果:
- 在工具环境中基于奖励的学习最好解释为基于工作记忆的快速过程和更慢的习惯性关联过程的组合.
- 无论是工作记忆还是习惯性过程,都不能单独与标准的RL算法保持一致.
- 这些发现表明,标准的RL算法本身并不能完全捕捉人类基于奖励的学习.
结论:
- 人类的基于奖励的学习得到了认知过程的组合的支持,包括工作记忆和协会学习,而不是仅仅是RL.
- 解释RL算法是普遍捕捉到一个单一的,有意义的学习过程,跨越大脑和行为需要批判性的重新评估.
- 未来的研究应该考虑多组件模型,以更好地了解人类仪器学习和决策的细微差别.
相关概念视频
01:21Cognitive Learning
981
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
981
01:26Higher Mental Functions of Brain: Learning and Memory
1.9K
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
1.9K
01:22Purposive Learning
426
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
426
01:24Working Memory
774
Working memory refers to a combination of components, including short-term memory and attention, that allow an individual to hold information temporarily as we perform cognitive tasks. It is an essential cognitive function that enables the execution of complex tasks such as problem-solving, comprehension, and reasoning. Unlike short-term memory, which simply involves the storage of information for a brief period, working memory involves the active manipulation and processing of this...
774
01:28Behaviorism
4.2K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
4.2K
01:18Incentive Theory: Pull Theory of Motivation
838
Incentive theory, or the "pull theory" of motivation, suggests that external rewards primarily drive behavior. Individuals are motivated to engage in activities when they anticipate a desirable outcome. This is why people often work hard for promotions or study intensively to achieve high grades. These incentives can be tangible, physical rewards such as money or promotions, or intangible, non-physical rewards like praise and social recognition.
The theory differentiates between...
The theory differentiates between...
838