贝叶斯强化学习在有限的认知负载下
Dilip Arumugam1, Mark K Ho2, Noah D Goodman1,3
1Department of Computer Science, Stanford University.
Open mind : discoveries in cognitive science
|April 26, 2024
概括
代理人必须学习并按照信息处理限制行事. 能力有限的贝叶斯强化学习提供了一个框架,以了解这些约束如何影响生物和人工系统的决策和学习.
科学领域:
- 认知科学 认知科学
- 计算机科学 计算机科学
- 决策理论 决策理论
背景情况:
- 适应性行为受到信息获取和处理限制的约束.
- 了解代理行为需要整合学习历史,决策和能力限制.
- 现有的理论往往不能完全解释处理限制的影响.
研究的目的:
- 审查能力有限的贝叶斯强化学习的最新算法和理论结果.
- 提出一个统一的规范框架,用于建模处理约束的影响.
- 突出这一框架在认知和行为科学中的应用.
主要方法:
- 来自强化学习,贝叶斯决策和速率扭曲理论的桥梁概念.
- 开发算法,明确模拟学习和决策中的能力限制.
- 综合了关于能力和适应性行为之间的相互作用的理论结果.
主要成果:
- 介绍了一个统一的框架,容量有限的贝叶斯增强学习.
- 该框架模拟了处理约束如何塑造学习和行动选择.
- 最近的算法和理论见解在这个框架内进行了审查.
结论:
- 能力有限的贝叶斯强化学习为研究适应性行为提供了一个强大的镜头.
- 这个框架为认知和行为科学研究提供了新的途径.
- 了解信息处理的极限对于一般的智能理论至关重要.
更多相关视频
09:43A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments
Published on: April 15, 2014
10.6K
08:42Assessment of Social Cognition in Non-human Primates Using a Network of Computerized Automated Learning Device ALDM Test Systems
Published on: May 5, 2015
12.1K
相关概念视频
Cognitive Learning
238
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
238
Associative Learning
345
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
345
Cognitivism
1.4K
Cognitive psychology emerged as a significant field in the mid-20th century. It focused on understanding humans' internal mental processes. This approach emphasizes how people perceive, remember, think, and solve problems—elements critical to human cognition.
Previously dominated by behaviorism, which prioritized observable behaviors and largely ignored mental processes, psychology transformed in the 1950s. Cognitive psychologists argue that understanding how we think and process...
Previously dominated by behaviorism, which prioritized observable behaviors and largely ignored mental processes, psychology transformed in the 1950s. Cognitive psychologists argue that understanding how we think and process...
1.4K
Introduction to Cognitive Psychology
477
Cognitive psychology is the field of psychology dedicated to examining how people think. It attempts to explain how and why we think the way we do by studying the interactions among human thinking, emotion, creativity, language, and problem-solving, as well as other cognitive processes. Cognitive psychology studies how information is processed and manipulated in remembering, thinking, and knowing.
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
477
Reason and Intuition
6.4K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.4K
The Availability Heuristic
6.0K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
6.0K
