Related Experiment Video
Updated: Sep 12, 2025

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy
Published on: October 14, 2017
Fixed-time optimal time-varying formation control for unmanned surface vehicle systems based on reinforcement
Qiaokun Kang1, Qintao Gan1, Ruihong Li1
1Shijiazhuang Campus, Army Engineering University of PLA, Shijiazhuang, 050003, China.
Abstract:
This article proposes the distributed fixed-time optimal time-varying formation control (TVFC) strategy based on reinforcement learning (RL) for unmanned surface vehicle systems (USVSs) with partially unmeasurable states and unknown dynamics. The fixed-time adaptive neural network state observer (FANNSO) is introduced for reconstructing unknown dynamics and unmeasurable states of the system. On this basis, a distributed optimization performance index function containing exponential terms is proposed, and a distributed fixed-time optimal TVFC strategy is developed by combining the actor-critic structure. This strategy achieves the dual objectives of formation control and cost optimization by adaptively adjusting the controller through the RL algorithm. Theoretical analyses show that the proposed control strategy can make the error signals bounded within a fixed time. Simulation results demonstrate the effectiveness and superiority of the method.
More Related Videos
Related Concept Videos
Feedback control systems
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Reinforcement Schedules
Once a behavior is learned,...
Time-Domain Interpretation of PD Control
Consider the example of control of motor torque. Initially, a positive...
Multi-input and Multi-variable systems
In the absence...
Controller Configurations
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
Root-Locus Method
This system can be represented by a block...

