在强化学习机制下的空间互惠
Lu Wang1, Xiaoqiu Shi1,2, Yang Zhou3
1School of Manufacturing Science and Engineering, Southwest University of Science and Technology, Mianyang, Sichuan 621000, China.
Chaos (Woodbury, N.Y.)
|February 3, 2025
概括
这项研究探讨了局部相互作用如何影响使用强化学习的代理人的合作行为. 合作中的空间互惠性只有在学习代理人和交互代理人重叠时才完全实现.
科学领域:
- 人工智能的人工智能
- 游戏理论 游戏理论
- 社会科学 社会科学 社会科学
背景情况:
- 目前在强化学习下对代理合作的研究往往假定全球互动或研究本地互动,而没有正式解决战略限制.
- 仅在本地互动的代理人面临着由网络结构影响的战略选择,这是一个经常被忽视的因素.
研究的目的:
- 研究社会决策环境中与个人和集体利益相冲突的代理人的合作行为.
- 分析本地与全球战略学习对合作演变的影响.
- 了解空间互惠在强化学习动态中的作用.
主要方法:
- 从游戏理论中利用囚犯困境游戏模型来表示社会困境.
- 单独研究了当地和全球战略学习对代理合作的影响.
- 在强化学习下检查了网络结构内的代理相互作用.
主要成果:
- 网络结构对促进合作的影响有限,因为互动和学习代理之间没有固有的联系.
- 空间互惠性是进化游戏理论中已知的效应,当相互作用和学习代理之间存在重叠时,它就会完全实现.
- 局部相互作用的局限性在合作困境中显著影响代理人的战略选择.
结论:
- 互动和学习代理之间的重叠程度对于实现合作行为中的空间互惠至关重要.
- 强化学习机制在发展合作时对代理相互作用的结构敏感.
- 了解局部相互作用动态是推动人工代理合作研究的关键.
相关概念视频
Reinforcement
177
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
177
Reinforcement Schedules
129
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
129
Primary and Secondary Reinforcers
170
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
170
Instinctive Drift
179
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
179
Observational Learning
123
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
123
Generalization, Discrimination, and Extinction
419
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
419


