Safe Reinforcement Learning for Nonlinear Multiagent Systems Based on Min--Max DMPC
Related Experiment Videos
Abstract:
This article presents a safe reinforcement learning (RL) framework for nonlinear multiagent systems (MASs) based on min-max distributed model predictive control (DMPC). The proposed method employs min-max DMPC as a robust baseline to generate control strategies, optimizing closed-loop performance in the presence of disturbances while ensuring interpretability and safety. To mitigate the conservatism inherent in traditional robust DMPC due to its reliance on precise models and fixed disturbance bounds, safe RL is introduced to adaptively update the controller parameters and disturbance sets online. The proposed parameter update mechanism of safe RL formally guarantees the recursive feasibility of the DMPC algorithm during the learning process. Furthermore, theoretical analyses of closed-loop stability are provided. The effectiveness and scalability of the proposed method are validated through two simulation examples.
Related Concept Videos
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
Reinforcement Schedules
Once a behavior is learned,...
State Space Representation
Consider an RLC circuit, a...
Time-Domain Interpretation of PD Control
Consider the example of control of motor torque. Initially, a positive...
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
PD Controller: Design
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...