强化学习用于通过改进Q函数来同步异质多代理系统
IEEE transactions on cybernetics
|September 24, 2024
概括
本研究引入了仲裁强化学习 (RL) 机制,以提高多代理系统 (MAS) 中的数据效率和适应性. 该方法使追随者能够与领导者同步,尽量减少个人表现,尽管环境变化.
科学领域:
- 人工智能的人工智能
- 控制系统 控制系统
- 机器学习 机器学习
背景情况:
- 当前的强化学习 (RL) 技术在多代理系统 (MAS) 中与数据效率和适应环境变化的能力扎.
- 在异构的MAS中实现最佳同步和最小化个体性能仍然是一个重大挑战.
研究的目的:
- 开发一种新的方法来提高MAS的RL技术的适应性和数据效率.
- 通过学习的联合控制协议,使MAS中的追随者能够与领导者同步并最大限度地降低个人表现.
主要方法:
- 为异质MASs制定一个最佳同步问题.
- 开发一个仲裁RL机制,其中包括一个改进的Q函数和一个仲裁因子.
- 通过在政策上和在政策之外的RL技术,对代理行为进行自适应的控制分配.
- 关于使用仅批评神经网络的仲裁RL算法的建议.
主要成果:
- 拟议的RL仲裁机制有效地应对数据不足和环境变化的挑战.
- 理论分析和证明证实了同步和性能优化.
- 模拟结果证明了开发方法的有效性.
结论:
- 仲裁RL方法显著提高了多代理同步的适应性和数据效率.
- 该方法提供了一个强大的解决方案,用于在动态和复杂的多代理环境中进行最佳控制.
相关概念视频
Multi-input and Multi-variable systems
101
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
101
Reinforcement Schedules
135
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
135
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
45
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
45
Stability of Equilibrium Configuration: Problem Solving
590
The stability of equilibrium configurations is an important concept in physics, engineering, and other related fields. In simple terms, it refers to the tendency of an object or system to return to its equilibrium position after being disturbed. The stability of an equilibrium configuration can be analyzed by considering the potential energy function of the system and examining its behavior near the equilibrium point.
Problem-solving in the context of the stability of equilibrium configuration...
Problem-solving in the context of the stability of equilibrium configuration...
590
BIBO stability of continuous and discrete -time systems
361
System stability is a fundamental concept in signal processing, often assessed using convolution. For a system to be considered bounded-input bounded-output (BIBO) stable, any bounded input signal must produce a bounded output signal. A bounded input signal is one where the modulus does not exceed a certain constant at any point in time.
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
361
Alternative Sets of Equilibrium Equations
376
When analyzing the behavior of structures, engineers often rely on the concept of equilibrium. This refers to the state where all forces and moments acting on a system balance each other, resulting in no net movement or rotation. In many cases, equilibrium can be described by a set of standard equations. However, in some situations, alternative sets of equilibrium equations must be used to describe the system's behavior accurately.
One example of such a situation can be observed in a...
One example of such a situation can be observed in a...
376


