Reinforcement Learning-Based Fault-Tolerant Control of Uncertain Strict-Feedback Nonlinear Systems With Intermittent
Abstract:
In this work, a novel reinforcement learning-based adaptive fault-tolerant control (FTC) scheme with actuator redundancy is presented for a nonlinear strict-feedback system with nonlinear dynamics and uncertainties. A learning-based switching function technique is established to steer different groups of actuators automatically and successively to mitigate the impact of faulty actuators by observing a switching performance index. The optimal tracking control problem (OTCP) of strict-feedback nonlinear systems is transformed into an equivalent optimal regulation problem of each affine subsystem via adaptive feedforward controllers. Subsequently, the designed objective functions associated with Hamilton-Jacobi-Bellman (HJB) estimate errors caused by neural network (NN) approximations can be minimized by the reinforcement learning algorithm without value or policy iterations. It is proved that the tracking objective can be achieved and all signals in the closed-loop system can be guaranteed to be bounded, as long as the minimum time interval between two successive failures is bounded. Theoretical results are verified by simulations.
Related Concept Videos
Feedback control systems
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Control Systems
At the heart...
Time-Domain Interpretation of PD Control
Consider the example of control of motor torque. Initially, a positive...
Controller Configurations
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
Open and closed-loop control systems
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
Effects of feedback
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...


