无模型决策抵制改进的指令,并通过刺激-反应关联来加强
Raúl Luna1, Miguel A Vadillo2, David Luque3
1Institute of Optics, Spanish National Research Council (CSIC), Spain.
Cortex; a journal devoted to the study of the nervous system and behavior
|September 10, 2023
概括
清晰的指令增强了基于模型的学习在人类行为. 奖励效应与刺激-反应关联有关,这表明学习策略之间存在微妙的相互作用.
科学领域:
- 认知科学 认知科学
- 神经科学是一个神经科学.
- 计算心理学 计算心理学
背景情况:
- 人类行为依赖于无模型和基于模型的学习机制.
- 无模型学习加强了基于奖励的刺激-反应关联.
- 基于模型的学习使用环境模型计算动作值.
研究的目的:
- 复制和验证有关任务指令对计算学习策略影响的研究结果.
- 研究奖励效应与刺激-反应学习之间的关系.
主要方法:
- 达席尔瓦和Hare (2020) 两阶段任务实验的复制.
- 行为分析,以区分无模型和基于模型的学习组件.
- 操纵任务指令以影响战略部署.
主要成果:
- 证实了详细的指令显著增加了基于模型的行为.
- 发现了一种显著的奖励效应,这种效应在有利于刺激-反应关联的条件下得到加强.
- 证明奖励的影响与刺激-反应学习有关.
结论:
- 任务指令在促进基于模型的学习策略方面发挥着至关重要的作用.
- 决策任务中的奖励效应不仅仅是无模型学习的标志,而且与刺激-反应关联有关.
- 人类决策涉及环境建模和协会学习之间的复杂相互作用.
相关概念视频
Associative Learning
434
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
434
Decision Making
140
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
140
Decision Making: Traditional Method
4.0K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.0K
Real-World Application of Classical Conditioning
621
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
621
Reason and Intuition
6.5K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.5K
Cognitive Learning
307
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
307


