人类在不同的学习环境中通过适应性来选择不同的计算策略
1Department of Experimental Psychology, Ghent University.
Psychological review
|April 15, 2024
概括
人类根据环境的复杂性来调整他们的学习策略. 简单的环境使用平面学习,而复杂的环境则使用层次模型来实现强化学习任务的最佳性能.
科学领域:
- 认知科学 认知科学
- 计算神经科学是一种神经科学.
- 行为经济学是一种行为经济学.
背景情况:
- 雷斯科拉 - 瓦格纳法则是人类强化学习的主要模型,但在复杂的环境中失败了.
- 层次扩展存在,但它们适应性使用和人类实施的条件尚不清楚.
研究的目的:
- 为了确定平面与等级学习策略的适应性.
- 研究人类在不同环境中实施的学习策略.
主要方法:
- 使用嵌套建模方法来评估多个计算模型.
- 分析了三个不同的强化学习环境中的10个实证数据集 (N=407).
- 模型以计算方式对性能进行了评估,并以实证方式对人类数据适应性进行了评估.
主要成果:
- 不同的环境需要不同的学习策略来实现最佳表现.
- 人类适应性地选择与环境复杂性保持一致的学习策略.
- 平面学习模型最能在简单,稳定的环境中解释行为.
- 在更复杂的环境中,等级学习模型更优越.
结论:
- 人类的学习策略是灵活的,并适应环境需求.
- 平面和层次强化学习之间的选择是由环境的复杂性驱动的.
- 研究结果支持人类在强化学习中对学习策略的适应性选择.
相关概念视频
Cognitive Learning
239
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
239
Problem-Solving
163
Effective problem-solving consists of two steps: 1. identifying the problem and 2. selecting the appropriate problem-solving strategy (i.e., a plan of action used to find a solution). Humans use four problem-solving strategies:
163
Trial and Error and Algorithm
112
A problem-solving strategy is a plan of action used to find a solution. Different strategies have distinct action plans. Trial and error involves trying different solutions until one works. For instance, to fix a broken printer, you might check ink levels, ensure the paper tray isn't jammed, and verify the printer's connection to your laptop. This method can be time-consuming but is commonly used. Thomas Edison, for example, used trial and error to find a suitable filament for the light...
112
Natural Selection and Adaptation
202
Natural selection, a fundamental concept in evolutionary biology, is the mechanism by which evolution is driven, favoring organisms that are best adapted to their environments. This process enhances their chances of survival and reproduction. Adaptation, a key outcome of this process, involves genetic modifications that optimize an organism's functionality under specific environmental challenges, such as extreme cold or thinner air at high altitudes.
Beyond physical adaptations,...
Beyond physical adaptations,...
202
Introduction to Learning
376
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
376


