人类决策平衡奖励最大化和政策压缩
Lucy Lai1,2, Samuel J Gershman3
1Program in Neuroscience, Harvard University, Cambridge, Massachusetts, United States of America.
PLoS computational biology
|April 26, 2024
概括
人类通过压缩政策来简化决策,交易奖励以获得认知轻松. 这种行为与能力有限的强化学习相一致,在记忆和时间限制下显示对可能的行动的偏见.
科学领域:
- 认知科学 认知科学
- 计算神经科学是一种神经科学.
- 强化学习是一种强化学习.
背景情况:
- 政策压缩是一个框架,解释了能力有限的代理人如何简化减少认知负载的行动.
- 了解人类在约束条件下的决策对于认知建模至关重要.
研究的目的:
- 为人类政策压缩提供行为证据.
- 测试能力有限的强化学习模型对人类行为的预测.
- 调查认知负载和时间压力如何影响政策简化.
主要方法:
- 在各种任务中进行行为实验.
- 分析与国家行动奖励结构相关的人类政策选择.
- 人类数据与能力有限的强化学习模型的比较.
主要成果:
- 人类表现出政策压缩,倾向于更简单的行动政策.
- 政策压缩涉及对高概率行动的偏见,抛弃国家信息.
- 这种偏差随着奖励政策的冗余性和内存负载而增加.
- 时间压力进一步降低了政策的复杂性,并增加了行动偏差.
结论:
- 在认知约束下的人类决策被政策压缩准确地描述.
- 认知资源的局限性促使人们采用简化的策略,尽管这些策略可能不足于最佳.
- 这些发现支持一个模型,在这个模型中,在时间压力下,从压缩代码中解码动作.
相关概念视频
Decision Making: P-value Method
5.3K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.3K
Reason and Intuition
6.4K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.4K
Decision Making: Traditional Method
4.0K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.0K
Decision Making
108
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
108
Timing and Consequences on Behavior
90
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
90
Self-Discrepancy Theory
18.3K
One influential perspective on what motivates people's behavior is detailed in Tory Higgin's self-discrepancy theory (Higgins, 1987). He proposed that people hold disagreeing internal representations of themselves that lead to different emotional states.
18.3K


