人类通过高效的编码来学习可概括的表示
Zeming Fang1,2, Chris R Sims3
1Brain Health Institute, National Center for Mental Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine and School of Psychology, Shanghai, 200030, China. zemingfang11@gmail.com.
Nature communications
|April 28, 2025
概括
这项研究通过添加高效的编码来增强强化学习 (RL),改善人类如何将过去的经验概括为新情况. 这种新模型比传统的RL方法更好地预测人类行为和概括.
科学领域:
- 认知科学 认知科学
- 计算神经科学是一种神经科学.
- 机器学习理论机器学习理论
背景情况:
- 强化学习 (RL) 理论认为,行为是由奖励最大化驱动的.
- 传统的RL模型很难解释人类如何将学习概括为新的情况.
- 在理解人类概括的基础上的表示机制方面存在差距.
研究的目的:
- 通过整合高效的编码原则来完善经典的强化学习框架.
- 通过强调简单的表示来解释人类概括的计算模型的开发.
- 测试高效编码是否提高RL预测人类概括的能力.
主要方法:
- 提出了一个新的RL框架,包括高效的编码 (最大限度的回报与最小的表示).
- 该框架预测刺激的蒸成抽象状态和利用奖励特征.
- 进行了两项实验,以评估与模型预测对比的人类概括性能.
主要成果:
- 集成高效编码的模型在概括任务中实现了人类水平的性能.
- 传统的RL模型在解释观察到的人类概括方面表现出显著的局限性.
- 这种精细的框架成功地预测了复杂的刺激如何被映射到紧的表征中.
结论:
- 高效的编码,当与RL相结合时,为理解人类学习和概括提供了一个更强大的框架.
- 使用简单,抽象表示的原则对于智能泛化至关重要.
- 这种增强的RL方法提供了对人类行为的更全面的计算解释.
相关概念视频
Encoding
80
Information enters the brain through encoding, which is the input of information into the memory system. Once sensory information is received from the environment, the brain labels or codes it. The information is then organized with similar information and connected to existing concepts. Encoding occurs through automatic processing and effortful processing.
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
80
Generalization, Discrimination, and Extinction
334
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
334
The Representativeness Heuristic
15.7K
The representative heuristic describes a biased way of thinking, in which you unintentionally stereotype someone or something. For example, you may assume that your professors spend their free time reading books and engaging in intellectual conversation, because the idea of them spending their time playing volleyball or visiting an amusement park does not fit in with your stereotypes of professors.
15.7K
Cognitive Learning
93
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
93
Higher Mental Functions of Brain: Learning and Memory
520
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
520
Concepts and Prototypes
52
The human nervous system handles vast amounts of information by translating sensory stimuli into neural impulses, which the brain processes, creating thoughts expressed through language or stored as memories. The brain also synthesizes information from emotions and memories, which significantly influence thoughts and behaviors. This intricate process creates a comprehensive mental picture.
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
52


