Fully Data-Driven Robust Output Formation Tracking Control for Heterogeneous Multiagent System With Multiple Leaders
IEEE Transactions on Cybernetics
|April 4, 2023
Summary
This study introduces a data-driven control method for multiagent systems (MAS) facing actuator faults. It enables follower agents to robustly track leader outputs and achieve formations using adaptive observers and reinforcement learning.
Area of Science:
- Control Systems
- Artificial Intelligence
- Robotics
Background:
- Traditional multiagent system (MAS) control often requires extensive prior knowledge.
- Actuator faults in MAS can degrade performance and compromise stability.
- Achieving robust formation tracking under uncertainty is a significant challenge.
Purpose of the Study:
- To develop a fully data-driven control framework for robust output formation tracking in MAS with actuator faults.
- To eliminate the need for detailed system prior knowledge in the control design.
- To ensure reliable formation control despite system uncertainties and faults.
Main Methods:
- A hierarchical, three-stage learning and control framework utilizing online data.
- Design of a distributed adaptive observer for leader state coordination and dynamics estimation.
- Application of an off-policy reinforcement learning (RL) method for acquiring feedback gains from partial observations.
- Integration of adaptive neural networks and robust compensations for fault-tolerant control.
Main Results:
- Successful estimation of unknown system dynamics and implicit acquisition of output regulation solutions.
- Effective learning of essential system models through the RL process.
- Robust output formation tracking achieved under actuator faults (efficiency loss, bias) using a model-free approach.
- Demonstrated stability of the learning and control algorithms through analysis.
Conclusions:
- The proposed fully data-driven method effectively addresses the robust output formation tracking problem in MAS with actuator faults.
- The hierarchical framework, leveraging adaptive observers and RL, offers a practical solution without requiring extensive system knowledge.
- Simulation results validate the efficacy and robustness of the developed control strategy.
Related Concept Videos
Distributed Loads: Problem Solving
686
Beams are structural elements commonly employed in engineering applications requiring different load-carrying capacities. The first step in analyzing a beam under a distributed load is to simplify the problem by dividing the load into smaller regions, which allows one to consider each region separately and calculate the magnitude of the equivalent resultant load acting on each portion of the beam. The magnitude of the equivalent resultant load for each region can be determined by calculating...
686
Control Systems
1.2K
Control systems are everywhere in contemporary society, influencing diverse applications from aerospace to automated manufacturing. These systems can be found naturally within biological processes, such as blood sugar regulation and heart rate adjustment in response to stress, as well as in man-made systems like elevators and automated vehicles. A control system is essentially a network of subsystems and processes that collaboratively convert specific inputs into desired outputs.
At the heart...
At the heart...
1.2K
Multimachine Stability
208
Multimachine stability analysis is crucial for understanding the dynamics and stability of power systems with multiple synchronous machines. The objective is to solve the swing equations for a network of M machines connected to an N-bus power system.
In analyzing the system, the nodal equations represent the relationship between bus voltages, machine voltages, and machine currents. The nodal equation is given by:
In analyzing the system, the nodal equations represent the relationship between bus voltages, machine voltages, and machine currents. The nodal equation is given by:
208
Multi-input and Multi-variable systems
134
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
134
Control System Problem
157
In an open-loop system, such as a basic thermostat, the poles of the transfer function influence the system's response but do not determine its stability. However, when feedback is introduced to form a closed-loop system, such as an advanced thermostat that adjusts heating based on room temperature, stability is governed by the new poles of the closed-loop transfer function.
When forming a closed-loop system, issues can arise if the poles cross into the unstable region, leading to potential...
When forming a closed-loop system, issues can arise if the poles cross into the unstable region, leading to potential...
157
Fault Types
111
When analyzing a single line-to-ground fault from phase A to ground at a three-phase bus, it is important to consider the fault impedance. This impedance is zero for a bolted fault, equal to the arc impedance for an arcing fault, and represents the total fault impedance for a transmission-line insulator flashover. To derive sequence and phase currents, fault conditions are translated from the phase domain to the sequence domain.
For line-to-line faults occurring between phases B and C, the...
For line-to-line faults occurring between phases B and C, the...
111


