Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Open and closed-loop control systems01:17

Open and closed-loop control systems

Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal and...
Control Systems01:10

Control Systems

Control systems are everywhere in contemporary society, influencing diverse applications from aerospace to automated manufacturing. These systems can be found naturally within biological processes, such as blood sugar regulation and heart rate adjustment in response to stress, as well as in man-made systems like elevators and automated vehicles. A control system is essentially a network of subsystems and processes that collaboratively convert specific inputs into desired outputs.
At the heart...
Feedback control systems01:26

Feedback control systems

Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
One-Degree-of-Freedom System01:24

One-Degree-of-Freedom System

In mechanical engineering, one-degree-of-freedom systems form the basis of a wide range of electrical and mechanical components. Using these models, engineers can predict the behavior of various parts in a larger system, which gives them insight into how different forces interact with each other.
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
Control Systems: Applications01:25

Control Systems: Applications

Electrical engineering plays a pivotal role in our daily lives, with control systems at the heart of many applications, from home appliances to sophisticated space shuttles. Control systems manage and regulate the behavior of devices and processes, ensuring they function safely, correctly, and efficiently.
In modern vehicles, control systems manage various functions to enhance performance and safety. The steering wheel and accelerator are primary inputs in a car's control system. The direction...
Three-Dimensional Force System:Problem Solving01:30

Three-Dimensional Force System:Problem Solving

A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Label-Free Clustering Analysis Platform Drives Cascaded Workflow for Scalable Production of Therapeutic Extracellular Vesicles.

Journal of extracellular vesiclesยท2026
Same author

Physicochemical, structural, and functional characterization of key bioactive proteins from Coptis chinensis leaf and root.

International journal of biological macromoleculesยท2026
Same author

Suppressing laser-power noise with a multifunctional liquid crystal polarization grating in miniaturized optically pumped magnetometers.

Microsystems & nanoengineeringยท2026
Same author

Chromosome-level genome assembly and population genomics analysis of <i>Camellia rubituberculata</i> provide insights into adaptation to karst habitats.

Plant diversityยท2026
Same author

Evaluating the effects of green development policies on energy security and carbon emissions reduction.

Fundamental researchยท2026
Same author

Association of Type 2 Diabetes and Body Mass Index with Arterial Stiffness: A Carotid Ultrasound Study.

Diabetes, metabolic syndrome and obesity : targets and therapyยท2026

Related Experiment Video

Updated: Jun 3, 2026

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy
11:53

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy

Published on: October 14, 2017

Learning-based fault-tolerant control for flexible joint robotic manipulators: An actor-critic framework with

Hejia Gao1, Chuanfeng He1, Tanyu Chen1

  • 1School of Artificial Intelligence, Anhui University, Hefei 230601, China; Engineering Research Center of Autonomous Unmanned System Technology, Ministry of Education, Hefei, Anhui, China; Anhui Provincial Key Laboratory of Security Artificial Intelligence, Anhui University, Hefei 230601, China.

ISA Transactions
|June 1, 2026
PubMed
Summary

This study introduces a novel fault-tolerant control strategy for flexible-joint robotic manipulators (FJRMs) using Lyapunov-guided actor-critic reinforcement learning (RL). The method enhances control robustness and tracking accuracy, even with actuator faults.

Keywords:
Actuator faultsAdaptive controlNeural networksReinforcement learningRobotic manipulator

Related Experiment Videos

Last Updated: Jun 3, 2026

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy
11:53

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy

Published on: October 14, 2017

Area of Science:

  • Robotics
  • Control Systems
  • Artificial Intelligence

Background:

  • Flexible-joint robotic manipulators (FJRMs) offer enhanced dexterity but present control challenges due to nonlinear dynamics, coupling, disturbances, and actuator faults.
  • Existing control methods often struggle with these complexities, particularly in fault-tolerant scenarios.

Purpose of the Study:

  • To develop a robust fault-tolerant control strategy for FJRMs.
  • To improve tracking accuracy and system stability in the presence of actuator faults and uncertainties.
  • To leverage reinforcement learning for adaptive control policy optimization.

Main Methods:

  • A Lyapunov-guided actor-critic reinforcement learning (RL) approach was implemented.
  • A critic network was utilized to learn the long-run cost-to-go, considering tracking error, control effort, and fault impact.
  • The critic's evaluation guided online actor policy improvement within a stabilizing Lyapunov control structure.

Main Results:

  • The proposed strategy demonstrated improved tracking accuracy and robustness on a Baxter robotic platform under faulty conditions.
  • Experimental results showed superior performance compared to PID and single neural-network controllers.
  • Semi-global uniform ultimate boundedness of all closed-loop signals was theoretically established.

Conclusions:

  • The Lyapunov-guided actor-critic RL strategy offers an effective solution for fault-tolerant control of FJRMs.
  • This approach provides enhanced adaptability and resilience against uncertainties and actuator faults.
  • The method represents a significant advancement over conventional control techniques for flexible robotic systems.