在不确定性下的顺序决策中学习的认知机制:一种实验和理论方法
Gloria Cecchini1,2, Michael DePass2, Emre Baspinar3
1Facultat de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Spain.
Frontiers in behavioral neuroscience
|August 27, 2024
概括
这项研究探讨了人们在不确定性下如何做出适应性决策. 参与者花了更长的时间来决定什么时候涉及到未来的后果,这表明他们对延迟的奖励和学习有了更深入的思考.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 决策科学 决策科学 决策科学
背景情况:
- 适应性决策依赖于评估后果以获得奖励.
- 在不确定的环境中理解认知过程对现实世界的决策至关重要,仍然有限.
- 探索是获得环境知识的关键,可以在没有明确反的情况下做出明智的选择.
研究的目的:
- 了解和正式化在不确定的背景下适应性决策背后的大脑机制.
- 调查个人如何学习和做出选择,并推迟后果和最小的反.
- 从探索中建模涉及到学习的神经认知过程.
主要方法:
- 设计了一项实验任务,人类参与者通过有限信息的顺序决定来最大限度地获得奖励.
- 记录参与者的反应时间和选择,分析学习时间和战略开发.
- 开发了一个结合神经群体动态和强化学习的计算模型来模拟决策过程.
主要成果:
- 对于具有未来后果的决策,参与者的反应时间增加了,这表明对延迟价值评估的认知努力更大.
- 参与者之间的学习时间差异很大,突出了个体适应能力的差异.
- 计算模型成功复制了行为模式,包括反应时间,选择和学习率.
结论:
- 延迟值计算及其整合到决策动态中是由拟议的神经认知模型解释的.
- 该研究通过内部绩效评估和探索,提供了关于学习如何在不确定的场景中发生的见解.
- 实验结果和模型都为理解不确定性下适应性决策提供了一个原则框架.
相关概念视频
01:20Decision Making
101
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
101
01:37Reason and Intuition
6.4K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.4K
01:14Decision Making: Traditional Method
4.0K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.0K
01:09Decision Making: P-value Method
5.3K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.3K
01:21Cognitive Learning
233
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
233
01:25The Anchoring-and-Adjustment Heuristic
7.2K
In order to make good decisions, we use our knowledge and our reasoning. Often, this knowledge and reasoning is sound and solid. However, sometimes, we are swayed by biases or by others manipulating a situation. For example, let’s say you and three friends wanted to rent a house and had a combined target budget of $1,600. The realtor shows you only very run-down houses for $1,600 and then shows you a very nice house for $2,000. Might you ask each person to pay more in rent to get the...
7.2K