Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Hierarchy of Motor Control01:18

Hierarchy of Motor Control

2.7K
The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
2.7K
Feedback control systems01:26

Feedback control systems

307
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
307
Time-Domain Interpretation of PD Control01:07

Time-Domain Interpretation of PD Control

105
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
105
PID Controller01:19

PID Controller

117
Proportional-Integral-Derivative (PID) controllers are widely used in various control systems to enhance stability and performance. In a thermostat, it adjusts heating or cooling based on the temperature difference between the actual and desired levels. They are often used in automotive speed systems, effectively managing sudden speed changes while maintaining a constant speed under varying conditions. On the other hand, PI controllers, commonly employed in voltage regulation, enhance stability...
117
PD Controller: Design01:26

PD Controller: Design

224
In automotive engineering, car suspension systems often employ Proportional Derivative (PD) controllers to enhance performance. PD controllers are utilized to adjust the damping force in response to road conditions. A controller, acting as an amplifier with a constant gain, demonstrates proportional control, with output directly mirroring input.
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
224
Open and closed-loop control systems01:17

Open and closed-loop control systems

737
Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
737

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Soft Robots for Intestinal Applications: A Review on Actuation, Materials, Manufacture and Applications.

The international journal of medical robotics + computer assisted surgery : MRCAS·2026
Same author

Dynamic hovering for uncrewed underwater vehicles via an error-separation-based cooperative strategy.

Communications engineering·2025
Same author

First Report of <i>Botrytis cinerea</i> Causing Gray Mold on <i>Cardamine violifolia</i> in China.

Plant disease·2025
Same author

Characterization of the complete chloroplast genome sequence of <i>Bassia scoparia</i> (L.) A. J. Scott 1978 (Amaranthaceae) and its phylogenetic analysis.

Mitochondrial DNA. Part B, Resources·2024
Same author

The complete chloroplast genome sequence of <i>Hydrocotyle vulgaris</i> L. (Araliaceae).

Mitochondrial DNA. Part B, Resources·2024
Same author

First Report of Powdery Mildew on <i>Cardamine violifolia</i> in China.

Plant disease·2024

Related Experiment Video

Updated: Jun 29, 2025

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
11:18

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

10.3K

Data-Driven Self-Triggered Control for Networked Motor Control Systems Using RNNs and Pre-Training: A Hierarchical

Wei Chen1, Haiying Wan1, Xiaoli Luan1

  • 1Key Laboratory of Advanced Process Control for Light Industry, Institute of Automation, Jiangnan University, Wuxi 214122, China.

Sensors (Basel, Switzerland)
|March 28, 2024
PubMed
Summary
This summary is machine-generated.

This study presents a novel hierarchical reinforcement learning method for networked motor control. The approach enhances learning efficiency and accuracy in self-triggered control systems.

Keywords:
hierarchical reinforcement learningnetworked motor control systemspre-trainingrecurrent neural networksself-triggered control

More Related Videos

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

4.4K
Acquisition of a High-precision Skilled Forelimb Reaching Task in Rats
08:59

Acquisition of a High-precision Skilled Forelimb Reaching Task in Rats

Published on: June 22, 2015

10.4K

Related Experiment Videos

Last Updated: Jun 29, 2025

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
11:18

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

10.3K
Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

4.4K
Acquisition of a High-precision Skilled Forelimb Reaching Task in Rats
08:59

Acquisition of a High-precision Skilled Forelimb Reaching Task in Rats

Published on: June 22, 2015

10.4K

Area of Science:

  • Robotics
  • Control Systems Engineering
  • Artificial Intelligence

Background:

  • Networked motor control systems require efficient and accurate control policies.
  • Traditional control methods can struggle with the complexity and dynamic nature of these systems.
  • Hierarchical reinforcement learning offers a promising avenue for improving control system performance.

Purpose of the Study:

  • To introduce a novel data-driven self-triggered control approach using hierarchical reinforcement learning.
  • To enhance the efficiency and accuracy of control policies in networked motor control systems.
  • To reduce the exploration space and improve the learning process through a layered policy structure.

Main Methods:

  • A hierarchical reinforcement learning framework with higher and lower-level policies was developed.
  • The dual-actor critic algorithm was integrated with interconnected neural networks to approximate policies.
  • Recurrent neural networks were employed for the critic architecture to capture temporal dependencies.
  • A pre-training method for control policy networks was introduced to boost learning efficiency.

Main Results:

  • The hierarchical structure effectively guided lower-level policy decision-making, reducing exploration.
  • The use of recurrent neural networks improved the critic's accuracy in approximating cost functions.
  • The integrated data-driven framework demonstrated enhanced learning efficiency.
  • Numerical simulations validated the effectiveness of the proposed self-triggered control method.

Conclusions:

  • The proposed data-driven, hierarchical reinforcement learning approach significantly improves self-triggered control in networked motor systems.
  • The layered policy design and recurrent neural network critic architecture enhance learning efficiency and accuracy.
  • This method offers a robust solution for complex control challenges in networked motor applications.