惊喜对年轻人和老年人的强化学习的影响
Christoph Koch1,2, Ondrej Zika1,3, Rasmus Bruckner1,4
1Max Planck Institute for Human Development, Berlin, Germany.
PLoS computational biology
|August 14, 2024
概括
年长的成年人在学习过程中表现出更高的惊喜敏感性,比年轻的成年人更容易适应意想不到的事件. 这表明,惊喜如何影响学习和决策,与年龄相关的差异.
科学领域:
- 认知神经科学 认知神经科学
- 计算精神病学是一种计算精神病学.
- 行为经济学是一种行为经济学.
背景情况:
- 惊喜对于学习至关重要,但它的计算作用和与年龄相关的变化仍在争论中.
- 惊喜通常与不确定性和结果概率同时发生,使分析复杂化.
- 了解从惊人的事件中学习的年龄差异对于认知健康很重要.
研究的目的:
- 调查人类如何从令人惊的事件中学习.
- 为了确定衰老是否会影响从惊喜中学习.
- 在学习任务中将惊喜与概率和不确定性分开.
主要方法:
- 102名参与者 (51名老年人,51名年轻人) 执行了高斯式和双模结果分布的学习任务.
- 使用不同的强盗分布,将结果的概率,不确定性和惊喜脱.
- 采用行为分析和学习率的计算建模.
主要成果:
- 两个年龄组都很难学习双模式盗的平均值.
- 在大预测错误后,参与者表现出选择逆转,这表明了惊喜敏感性.
- 老年人对惊喜的反应更强烈,这表明过度适应.
结论:
- 在年轻人和老年人中,学习速度受到惊喜的影响,而不是不确定性.
- 老年人可能过度适应意外事件,影响学习.
- 研究结果将行为经济学和强化学习与年龄相关的学习差异相结合.
相关概念视频
Timing and Consequences on Behavior
87
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
87
Reinforcement Schedules
138
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
138
Behaviorism
2.3K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
2.3K
Law of Effect
1.3K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.3K
Confirmation Biases
5.5K
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
5.5K
Randomized Experiments
6.8K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
6.8K


