在惩罚下合作的出现:强化学习的视角
Chenyang Zhao1, Guozhong Zheng1, Chun Zhang2
1School of Physics and Information Technology, Shaanxi Normal University, Xi'an 710061, People's Republic of China.
Chaos (Woodbury, N.Y.)
|July 10, 2024
概括
在囚犯困境游戏中的惩罚可以触发合作阶段的过渡,类似于液态气体的变化. 强化学习揭示了推动这些合作动态的复杂"心理"转变.
科学领域:
- 计算社会科学 计算社会科学
- 游戏理论 游戏理论
- 基于代理的建模模型
背景情况:
- 维持合作对社会系统至关重要.
- 传统的游戏理论经常使用模仿学习.
- 真实世界的学习动态比简单的模仿要复杂得多.
研究的目的:
- 通过强化学习研究合作动态.
- 在囚犯困境游戏中示范惩罚策略.
- 分析合作的阶段过渡和核化过程.
主要方法:
- 在强化学习框架内使用了Q学习算法.
- 模拟了囚犯的困境游戏,由合作者对叛逃者的概率惩罚.
- 分析了Q表的演变,以了解决策和合作模式.
主要成果:
- 惩罚可以诱导连续和不连续的合作阶段过渡.
- 观察到合作集群的核化类似于液态气体过渡.
- Q表分析揭示了推动合作水平的潜在"心理"变化.
结论:
- 强化学习提供了比模仿学习更细致的合作视角.
- 惩罚可能导致一级阶段过渡,需要仔细执行.
- 该研究提供了关于在社会困境中合作的出现和稳定性的见解.
相关概念视频
Punishment
167
Negative reinforcement and punishment are often confused but serve distinct functions in behavior modification. Reinforcement, whether positive or negative, increases the likelihood of a desired behavior, while punishment decreases it.
Punishment can be positive or negative. Positive punishment involves adding an undesirable stimulus, such as scolding, to decrease a behavior. Negative punishment involves removing a desirable stimulus, such as taking away a favorite toy, to decrease behavior....
Punishment can be positive or negative. Positive punishment involves adding an undesirable stimulus, such as scolding, to decrease a behavior. Negative punishment involves removing a desirable stimulus, such as taking away a favorite toy, to decrease behavior....
167
Operant Conditioning
1.6K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
1.6K
Law of Effect
1.4K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.4K
Timing and Consequences on Behavior
88
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
88
Operant Conditioning Intervention
56
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...
56
Reinforcement
202
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
202


