个性混合改善了增强行为者网络,以实现高效的多代理合作
Xiyun Li1,2, Ziyi Ni1,3, Jingqing Ruan1,2
1Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
Frontiers in neuroscience
|July 24, 2023
概括
这项研究介绍了一种新的个性混合 (MoP) 改进的Spiking Actor Network (SAN) 算法,以增强强化学习中与看不见的合作伙伴的多代理合作. 在合作任务中,MoP-SAN算法展示了卓越的性能和概括能力.
科学领域:
- 人工智能的人工智能
- 认知科学 认知科学
- 计算神经科学是一种神经科学.
背景情况:
- 多代理强化学习 (MARL) 在适应新的,未见的合作伙伴方面面临挑战,这个问题被称为新玩家概括不良.
- 在MARL中现有的深度学习算法往往忽视了思维理论 (ToM) 的作用,阻碍了适应性合作.
- 人类的认知利用直观的个性预测来导航社会互动,为AI提供了一个模型.
研究的目的:
- 开发一种生物可信的MARL算法,以改善与未见的合作伙伴的合作.
- 将思维理论原则集成到一个尖端的神经网络架构中,以提高概括性.
- 为了解决MARL中糟糕的新玩家泛化问题.
主要方法:
- 提出了一个名为人格混合 (MoP) 的新算法,改进了尖端演员网络 (SAN).
- 该MOP模块使用一个确定点的过程来模拟个性形成和整合.
- 该SAN模块结合了尖端神经元,以实现高效的强化学习.
主要成果:
- 在合作任务中,MoP-SAN算法实现了更高的性能,无论是与未见的合作伙伴还是没有合作伙伴.
- 废弃研究证实了MoP模块对SAN学习能力的重大贡献.
- 与传统的深度演员网络相比,该算法表现出卓越的性能.
结论:
- 拟议的MoP-SAN算法有效地增强了适应性的多代理合作,特别是在涉及未见的合作伙伴的场景中.
- 将思想理论启发的个性建模集成到尖端的神经网络中,为MARL研究提供了一个有希望的方向.
- 这些发现表明,模拟直观的人格预测对于MARL系统中强大的概括至关重要.
相关概念视频
Masking and Demasking Agents
2.5K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
2.5K
Social Facilitation
32.0K
Not all intergroup interactions lead to negative outcomes. Sometimes, being in a group situation can improve performance. Social facilitation occurs when an individual performs better when an audience is watching than when the individual performs the behavior alone. This typically occurs when people are performing a task for which they are skilled.
32.0K
Robbers Cave
14.3K
During the 1950s, the landmark Robbers Cave experiment demonstrated that when groups must compete with one another, intergroup conflict, hostility, and even violence may result. At the Oklahoman summer camp, two troops of boys—termed the Rattlers and the Eagles—took part in a week-long tournament. During this time, their negativity culminated in derogatory name-calling, fistfights, and even vandalism and destruction of property. However, this work also revealed that such tension...
14.3K
Muscle Coordination and Action
1.6K
Muscle coordination is a complex and finely tuned process essential for smooth and purposeful movements like flexion, extension, adduction, abduction, and rotation. The human body orchestrates the actions of various muscles working in concert, each with a specific role. Four functional types describe how muscles work together: agonist, antagonist, synergist, and fixator.
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement....
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement....
1.6K
Collisions in Multiple Dimensions: Problem Solving
4.3K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
4.3K
Nonconscious Mimicry
4.6K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.6K


