坚持和基于启发式定向探索的签名在两步顺序决策任务行为中
Angela Mariele Brands1, David Mathar1, Jan Peters1
1Biological Psychology, Department of Psychology, University of Cologne, Germany.
Computational psychiatry (Cambridge, Mass.)
|February 17, 2025
概括
这项研究增强了强化学习 (RL) 的计算模型,以更好地理解精神疾病中的探索和坚持. 结果显示,一个更复杂的RL模型最能解释决策,为计算精神病学提供了洞察力.
科学领域:
- 认知神经科学 认知神经科学
- 计算精神病学是一种计算精神病学.
- 强化学习的学习理论
背景情况:
- 强化学习 (RL) 过程,如基于模型 (MB) 的控制和探索,在神经科学和精神病学中至关重要.
- 这些RL过程中的失调与精神疾病有关,但它们通常被孤立地研究.
- 标准混合模型的两步任务 (TST) 用于测量MB控制.
研究的目的:
- 扩展TST的标准混合模型,以量化勘探和坚持机制.
- 为了比较TST的不同计算模型扩展.
- 研究精神病学背景下决策的神经计算基础.
主要方法:
- 实现并比较各种计算模型扩展用于一个连续的RL任务 (两步任务).
- 利用来自不同任务变体的两个独立数据集.
- 采用后期预测检查来验证模型性能.
主要成果:
- 一个扩展的混合RL模型结合了更高阶的坚持和基于启发式的探索,提供了最适合数据的模型.
- 一个简单的模型,只有复杂的坚持也很适合.
- 确定了定向勘探对第一阶段选择概率的显著积极影响.
结论:
- 扩展的RL模型成功地在两个数据集中复制了选择模式.
- 调查结果强调了考虑联合勘探和坚持机制的重要性.
- 结果对计算精神病学和识别神经认知内分类型有影响.
更多相关视频
07:05Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
Published on: September 10, 2018
5.9K
07:09Integrating Visual Psychophysical Assays within a Y-Maze to Isolate the Role that Visual Features Play in Navigational Decisions
Published on: May 2, 2019
6.0K
相关概念视频
Heuristics
67
Heuristics are problem-solving strategies that use mental shortcuts to simplify decision-making. Unlike algorithms, which must be followed precisely to achieve a correct result, heuristics offer a general problem-solving framework. They save time and energy but can sometimes lead to less rational decisions.
People often rely on heuristics when faced with an overload of information, limited time, low importance of the decision, limited information, or when a heuristic readily comes to mind. For...
People often rely on heuristics when faced with an overload of information, limited time, low importance of the decision, limited information, or when a heuristic readily comes to mind. For...
67
Reason and Intuition
6.3K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.3K
Problem-Solving
125
Effective problem-solving consists of two steps: 1. identifying the problem and 2. selecting the appropriate problem-solving strategy (i.e., a plan of action used to find a solution). Humans use four problem-solving strategies:
125
Decision Making
84
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
84
The Availability Heuristic
5.9K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
5.9K
Cognitive Learning
219
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
219
