Related Experiment Video
Updated: Jan 17, 2026

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy
Published on: October 14, 2017
Reinforcement Learning-Based Boundary-Optimized Control of Flexible Manipulators Under Jointly Connected Switching
Abstract:
This article pioneers the study of boundary-optimized fault-tolerant tracking control for flexible manipulators in a switching digraph with a heterogeneous linear leader. Compared with existing research, the proposed methods have several features. First, a distributed observer is designed to observe the leader's information in a general switching graph where communication can be interrupted. Second, a new partial differential equation (PDE)-based fault observer (FO) is designed to estimate unknown faults using only a few boundary states. Third, a novel long-term integral cost function is formulated to minimize angle-tracking errors, vibration deflections, and control energy in flexible manipulators. The ideal boundary optimal control laws are, then, derived and approximated using actor-critic neural networks (NNs) based on reinforcement learning (RL). Under the proposed fully distributed optimized fault-tolerant controllers, the closed-loop flexible manipulator's error states are proven uniformly ultimately bounded (UUB). Finally, the effectiveness of the proposed method is demonstrated through numerical simulation results.
Related Concept Videos
Open and closed-loop control systems
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
Woodward–Hoffmann Selection Rules and Microscopic Reversibility
Hierarchy of Motor Control
Controller Configurations
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
Control Systems
At the heart...
Feedback control systems
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...

