Finite-Horizon Optimal Consensus Control for Unknown Multiagent State-Delay Systems
Abstract:
This paper investigates finite-horizon optimal consensus control problem for unknown multiagent systems with state delays. It is well known that optimal consensus control is the solutions to the coupled Hamilton-Jacobi-Bellman (HJB) equations. An off-policy reinforcement learning (RL) algorithm is developed to learn the two-stage optimal consensus solutions to the coupled time-varying HJB equations using the measurable state data instead of the knowledge of the state-delayed system dynamics. Subsequently, for each agent, a single critic neural network (NN) is utilized to approximate the time-varying cost function and help to calculate optimal consensus control policy. Based on the method of weighted residuals, adaptive weight update laws for the critic NNs are proposed. Finally, the simulation results are provided to illustrate the effectiveness of the proposed off-policy RL method.
Related Concept Videos
01:10Control Systems
At the heart...
01:25Control Systems: Applications
In modern vehicles, control systems manage various functions to enhance performance and safety. The steering wheel and accelerator are primary inputs in a car's control system. The...
01:26Feedback control systems
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
01:17Open and closed-loop control systems
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
01:21Transfer Function in Control Systems
To derive the transfer function, consider a general nth-order linear time-invariant...
01:21Schwarzschild Radius and Event Horizon
The minimum speed required to launch a projectile from the surface of an object to which it is gravitationally bound so that it eventually escapes the object’s gravitational field is called the escape velocity. The escape velocity is independent of the mass of the object. Merging the idea of escape...