基于时间变化的HJBE适应性安全关键控制设计,用于随机不对称的受约束多代理系统
IEEE transactions on cybernetics
|March 4, 2026
概括
本研究介绍了对具有约束的随机多代理系统 (MAS) 的自适应安全批评控制. 这种新的方法确保了系统稳定性和最佳控制政策,使用了整体强化学习和经验重复.
科学领域:
- 控制工程 控制工程 控制工程
- 人工智能的人工智能
- 系统科学 系统科学
背景情况:
- 随机多代理系统 (MAS) 由于不对称状态和输入约束而存在挑战.
- 为此类系统设计适应性和安全的控制需要强大的方法.
研究的目的:
- 为具有不对称约束的随机MAS开发一个适应的安全关键控制设计.
- 为了解决输入限制,并提高控制器对随机干扰的稳定性.
主要方法:
- 一个统一的转换函数 (UTF) 将受约束的问题转换为不受约束的错误系统.
- 一个非二次性成本函数处理输入限制.
- 一个时间变化的汉密尔顿 - 雅各比 - 贝尔曼方程 (HJBE) 是用贝尔曼原理和伊托定理来制定的.
- 综合强化学习 (IRL) 和时间变化的单关键网络接近HJBE解决方案.
- 经验重复 (ER) 技术提高了学习效率,并缓解了持续的兴奋状况.
主要成果:
- 拟议的方法有效地处理非对称状态和随机MAS中的输入约束.
- 综合强化学习方法消除了对显式漂移动态的需求.
- 单关键网络显著降低了计算复杂性.
- 模拟示例验证了该方法的可行性和有效性.
结论:
- 开发的自适应安全关键控制框架为受约束的随机MAS提供了强大的解决方案.
- 集成IRL和ER提供了一个高效和数据驱动的控制策略.
- 该方法显示了学习效率和计算负载的显著改善.
相关概念视频
01:22Multi-input and Multi-variable systems
449
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
449
01:16Statically Indeterminate Problem Solving
803
Statically indeterminate problems are those where statics alone can not determine the internal forces or reactions. Consider a structure comprising two cylindrical rods made of steel and brass. These rods are joined at point B and restrained by rigid supports at points A and C. Now, the reactions at points A and C and the deflection at point B are to be determined. This rod structure is classified as statically indeterminate as the structure has more supports than are necessary for maintaining...
803
01:26Feedback control systems
753
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
753
01:24BIBO stability of continuous and discrete -time systems
995
System stability is a fundamental concept in signal processing, often assessed using convolution. For a system to be considered bounded-input bounded-output (BIBO) stable, any bounded input signal must produce a bounded output signal. A bounded input signal is one where the modulus does not exceed a certain constant at any point in time.
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
995
01:13Stability of Equilibrium Configuration: Problem Solving
1.1K
The stability of equilibrium configurations is an important concept in physics, engineering, and other related fields. In simple terms, it refers to the tendency of an object or system to return to its equilibrium position after being disturbed. The stability of an equilibrium configuration can be analyzed by considering the potential energy function of the system and examining its behavior near the equilibrium point.
Problem-solving in the context of the stability of equilibrium configuration...
Problem-solving in the context of the stability of equilibrium configuration...
1.1K
01:17Open and closed-loop control systems
1.9K
Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
1.9K