Q-learning based fault estimation and fault tolerant iterative learning control for MIMO systems
Rui Wang1, Zhihe Zhuang1, Hongfeng Tao1
1Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), Jiangnan University, Wuxi 214122, China.
Abstract:
This paper proposes a Q-learning based fault estimation (FE) and fault tolerant control (FTC) scheme under iterative learning control (ILC) framework. Due to the repetitive demands on control actuators for repetitive tasks, ILC is sensitive to actuator faults. Moreover, unknown faults varying with both time and trial axes pose a challenge to the control performance of ILC. This paper introduces Q-learning algorithm for FE to continuously adjust the estimator and adapt the changing faults. Then, FTC is designed by adopting the norm-optimal iterative learning control (NOILC) framework, where the controller is adjusted based on the FE results from Q-learning to counteract the influence of faults. Finally, the simulation on the plant of a mobile robot verifies the effectiveness of the proposed algorithm.
Related Concept Videos
Propagation of Uncertainty from Systematic Error
BIBO stability of continuous and discrete -time systems
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
Multi-input and Multi-variable systems
In the absence...
Feedback control systems
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Propagation of Uncertainty from Random Error
Open and closed-loop control systems
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...


