积极强化学习与行动偏见和歇斯底里症相比:用专家和非专家混合的控制
Jaron T Colas1,2,3, John P O'Doherty2,3, Scott T Grafton1
1Department of Psychological and Brain Sciences, University of California, Santa Barbara, California, United States of America.
PLoS computational biology
|March 29, 2024
概括
强化学习模型必须考虑行动偏差和歇斯底里,而不仅仅是奖励. 这些因素显著影响人类的选择,甚至在简单的任务,影响学习和行为控制.
科学领域:
- 认知科学 认知科学
- 计算神经科学是一种神经科学.
- 行为经济学是一种行为经济学.
背景情况:
- 积极强化学习平衡奖励最大化与尽量减少成本,如推断和决策时间.
- 人类的决策受物理行动特征的影响,而不仅仅是奖励结果.
- 现有的模型往往忽视了动作偏差和歇斯底里斯作为顺序选择中差异的来源.
研究的目的:
- 调查行动偏差和歇斯底里如何使强化学习模型复杂化.
- 测试人类顺序选择数据,以寻找超越一般化强化学习的并行模块的签名.
- 量化行动偏见和歇斯底里斯对学习和决策的影响.
主要方法:
- 从层次结构化任务中开发和比较顺序选择数据的计算模型.
- 采用系统的模型比较和伪造来识别行为特征.
- 分析了人类的选择,以证实强化学习,动作偏见和动作歇斯底里.
主要成果:
- 发现了行动偏差和歇斯底里斯的显著个体差异,与学习差异相比.
- 观察到学习较差的个体表现出更大的偏见,但准确的学习者也具有偏见.
- 鉴定了由先前的行动历史影响的多样化的歇斯底里方向 (重复与交替).
结论:
- 动作偏差和歇斯底里是人类顺序选择中的强大,无处不在的现象,即使是最低限度的运动需求.
- 这些偏见充当有效控制的启发式,通过尽量减少努力来适应不确定性或低动机.
- 这些发现扩大了行为控制理论,包括专家和非专家控制者的混合.
相关概念视频
01:12Hindsight Biases
3.4K
Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now?
3.4K
01:14Decision Making: Traditional Method
4.0K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.0K
01:25The Anchoring-and-Adjustment Heuristic
7.2K
In order to make good decisions, we use our knowledge and our reasoning. Often, this knowledge and reasoning is sound and solid. However, sometimes, we are swayed by biases or by others manipulating a situation. For example, let’s say you and three friends wanted to rent a house and had a combined target budget of $1,600. The realtor shows you only very run-down houses for $1,600 and then shows you a very nice house for $2,000. Might you ask each person to pay more in rent to get the...
7.2K
01:26Feedback control systems
307
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
307
01:10Control Systems
1.1K
Control systems are everywhere in contemporary society, influencing diverse applications from aerospace to automated manufacturing. These systems can be found naturally within biological processes, such as blood sugar regulation and heart rate adjustment in response to stress, as well as in man-made systems like elevators and automated vehicles. A control system is essentially a network of subsystems and processes that collaboratively convert specific inputs into desired outputs.
At the heart...
At the heart...
1.1K
01:22Bias
4.2K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
4.2K