在认知控制和强化学习范式之间整合的共享时间窗口:一个相关研究
Nicola Vasta1, Shengjie Xu2, Tom Verguts2
1Department of Psychology and Cognitive Science, University of Trento, Corso Bettini, 31, 38068, Rovereto, TN, Italy. nicola.vasta@unitn.it.
Memory & cognition
|August 28, 2024
概括
认知控制和强化学习可能有共同的潜在机制. 这项研究发现了控制学习和强化学习之间的共享学习过程,特别是在需要特定功能更新的任务中.
科学领域:
- 认知神经科学 认知神经科学
- 计算精神病学是一种计算精神病学.
背景情况:
- 认知控制通过取代自动反应来实现目标导向的行为.
- 强化学习涉及获得基于反和奖励的行动.
- 最近的理论表明,认知控制和强化学习之间的潜在重叠.
研究的目的:
- 研究认知控制和强化学习之间的共享学习机制.
- 确定控制学习和强化学习率中是否存在类似的集成时间窗口.
- 探索控制学习和强化学习参数之间的关系.
主要方法:
- 一个大型公共数据集的相关性分析 (n=522).
- 利用了来自概率选择任务,概率威斯康星州卡片排序任务 (WCST) 和Stroop任务的数据.
- 检查了控制指数和学习率参数的时间尺度.
主要成果:
- 在概率性WCST中发现了对照指数时间尺度和学习率之间的显著相关性.
- 没有观察到两个强化学习任务的学习率参数之间的相关性.
- 在强化学习中指定的特定任务价值更新过程.
结论:
- 建议共享的学习机制是认知控制和强化学习的基础.
- 强调了强化学习中的价值更新可以是特定任务的.
- 建议Stroop和WCST等任务可以由于特征特定要求共享更新机制.
相关概念视频
Cognitive Learning
233
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
233
Associative Learning
317
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
317
Reinforcement Schedules
138
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
138
Operant Conditioning Intervention
52
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...
52
Cognitivism
1.4K
Cognitive psychology emerged as a significant field in the mid-20th century. It focused on understanding humans' internal mental processes. This approach emphasizes how people perceive, remember, think, and solve problems—elements critical to human cognition.
Previously dominated by behaviorism, which prioritized observable behaviors and largely ignored mental processes, psychology transformed in the 1950s. Cognitive psychologists argue that understanding how we think and process...
Previously dominated by behaviorism, which prioritized observable behaviors and largely ignored mental processes, psychology transformed in the 1950s. Cognitive psychologists argue that understanding how we think and process...
1.4K
Law of Effect
1.3K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.3K


