协同学习神经控制对于未知同源非线性系统与异交稳定性保证
IEEE transactions on neural networks and learning systems
|January 8, 2024
概括
一个新的协同学习算法 (SLA) 能够对未知的非线性系统进行最佳控制. 这种无模型方法使用强化学习来确保系统稳定性和优化性能,而不需要系统动态.
科学领域:
- 控制系统工程 控制系统工程
- 机器学习 机器学习
- 非线性动力学是一种非线性动力学.
背景情况:
- 对于未知的非线性系统来说,最优的控制是具有挑战性的.
- 传统方法通常需要完整的系统动态知识.
- 强化学习提供了一个潜在的无模型解决方案.
研究的目的:
- 开发一个协同学习算法 (SLA),以优化对未知同源非线性系统的控制.
- 使用非政策强化学习建立一个无模型的汉密尔顿-雅各比-贝尔曼方程 (MF-HJBE).
- 使用开发的SLA,证明非对称稳定性和成本函数优化.
主要方法:
- 通过非政策的强化学习来扣除无模型的HJBE (MF-HJBE).
- 基于解决方案的独特性,弥合HJBE和MF-HJBE之间的等价性.
- 采用双代理协同学习 (SL) 系统 (批评者和演员代理) 与基于经验重复 (ER) 的学习规则.
主要成果:
- 当MF-HJBE解决方案存在时,它保证了非对称的系统稳定性和最佳的成本功能.
- 关键代理向最佳成本函数发展.
- 演员代理向最佳控制方向发展,并确保系统的非对称稳定性.
结论:
- 开发的SLA有效地学习了未知的非线性系统的最佳控制.
- 使用RL的无模型方法为传统方法提供了强大的替代方案.
- 模拟证实了SLA对复杂系统的可行性和有效性.
相关概念视频
Feedback control systems
314
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
314
Linear Approximation in Frequency Domain
91
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
91
Linear Approximation in Time Domain
83
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
83
Open and closed-loop control systems
753
Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
753
Control Systems
1.1K
Control systems are everywhere in contemporary society, influencing diverse applications from aerospace to automated manufacturing. These systems can be found naturally within biological processes, such as blood sugar regulation and heart rate adjustment in response to stress, as well as in man-made systems like elevators and automated vehicles. A control system is essentially a network of subsystems and processes that collaboratively convert specific inputs into desired outputs.
At the heart...
At the heart...
1.1K
SFG Algebra
118
In Signal Flow Graph (SFG) algebra, the value a node represents is determined by the sum of all signals entering that node. This summed value is then transmitted through every branch leaving the node, making the SFG a powerful tool for visualizing and analyzing control systems.
Each node in an SFG corresponds to a variable, and the interactions between nodes are represented by branches with associated gains. When multiple branches lead into a node, the value at that node is the sum of the...
Each node in an SFG corresponds to a variable, and the interactions between nodes are represented by branches with associated gains. When multiple branches lead into a node, the value at that node is the sum of the...
118


