在盗任务中观察学习勘探开发策略
Ludwig Danwitz1, Bettina von Helversen1
1Department of Psychology, University of Bremen, Germany.
Cognition
|March 21, 2025
概括
人们在决策中模仿别人,尤其是在不确定的情况下. 他们还根据观察到的行为调整他们的探索策略,影响社会和非社会信息的处理方式.
科学领域:
- 认知心理学 认知心理学
- 行为经济学是一种行为经济学.
- 强化学习是一种强化学习.
背景情况:
- 决策涉及到平衡新的选项的探索和已知的选项的利用 (勘探-开发权衡).
- 观察式学习,即个人通过观察他人来学习,在决策中很常见,但其在探索-开发困境中的作用尚不清楚.
- 了解个人何时,如何以及从谁那里利用观察学习对于理解社会对选择行为的影响至关重要.
研究的目的:
- 调查观察他人如何影响个人对勘探-开采权衡的做法.
- 确定个人在决策任务期间从事观察学习的条件.
- 分析利用社会信息进行勘探和开发的机制和个体差异.
主要方法:
- 两次实验使用多臂强盗任务,参与者要么单独行动,要么观察虚构的代理人.
- 用一种强化学习模型 (简化的卡尔曼波器) 来量化个人级别的复制和探索行为.
- 分析重点是观察到的代理策略 (探索性与剥削性) 如何影响参与者的选择和学习参数.
主要成果:
- 参与者将观察到的行为纳入了他们自己的价值估计中添加了奖金,表明了复制行为.
- 一部分参与者表现出"在不确定时复制"的策略,随着他们自己的知识下降,复制的数量增加.
- 观察到的探索策略影响了参与者自身的探索调整,这表明了一种模拟形式,尽管对复制特定代理类型的偏好是模两可的.
结论:
- 人类将社会信息整合到探索-利用决策中,通常是根据观察到的行为调整自己的学习和探索速度.
- 存在个体差异,有些人采用了更加依赖上下文 (基于不确定性) 的复制策略.
- 该研究强调了社会观察和个人学习之间的复杂相互作用,以应对不确定性和优化决策.
相关概念视频
01:12Observational Learning
111
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
111
02:30Naturalistic Observations
15.3K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
15.3K
01:21Cognitive Learning
122
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
122
01:14Steps in the Modeling Process
159
Albert Bandura's theory of observational learning identifies four critical processes: attention, retention, motor reproduction, and reinforcement or motivation.
Attention is the first necessary component for observational learning. It involves focusing on what the model is doing and saying. For example, if you decide to take a drawing class to enhance your skills, you need to pay close attention to the instructor's words and hand movements. The characteristics of the model significantly...
Attention is the first necessary component for observational learning. It involves focusing on what the model is doing and saying. For example, if you decide to take a drawing class to enhance your skills, you need to pay close attention to the instructor's words and hand movements. The characteristics of the model significantly...
159
01:05Instinctive Drift
169
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
169
01:28Behaviorism
2.2K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
2.2K