样本效率高的多剂增强学习与面具重建
Jung In Kim1, Young Jae Lee1, Jongkook Heo1
1School of Industrial and Management Engineering, Korea University, Seoul, Republic of Korea.
PloS one
|September 14, 2023
概括
本研究介绍了M-QMIX,这是一种针对多代理系统的改进深度强化学习 (DRL) 方法. M-QMIX提高了样本效率,减少了复杂环境中的培训时间和数据需求.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 多代理系统 多代理系统
背景情况:
- 深度强化学习 (DRL) 结合了强化学习 (RL) 和深度学习,用于复杂的决策.
- DRL面临的挑战是采样效率,需要大量的数据和培训时间,特别是在多代理强化学习 (MARL).
研究的目的:
- 通过引入面具重建任务来提高多代理强化学习的样本效率.
- 解决多代理系统中DRL的基本局限性.
主要方法:
- 提出了一种新的方法,将掩面重建任务与QMIX相结合,称为M-QMIX.
- 使用了StarCraft II微管理基准,使用了11种不同的场景 (容易,困难,非常困难).
- 专注于通过每个场景的有限数量的时间步骤来证明更好的样本效率.
主要成果:
- 与QMIX相比,M-QMIX在11个场景中的8个场景中表现出更好的表现.
- 提出的方法在时间限制下显著提高了样本效率.
- 在StarCraft II上的实验验证证证了这种方法的有效性.
结论:
- M-QMIX 方法有效地解决了多剂系统中 DRL 的样本效率限制.
- 整合一个掩盖的重建任务是改善MARL性能的一种可行的策略.
- 这些发现表明了开发更高效的MARL算法的有希望的方向.
相关概念视频
Masking and Demasking Agents
2.5K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
2.5K
Reinforcement
273
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
273
Observational Learning
207
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
207
Reinforcement Schedules
202
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
202
Associative Learning
434
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
434
Multi-input and Multi-variable systems
127
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
127


