Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Feedback control systems01:26

Feedback control systems

500
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
500
Control Systems01:10

Control Systems

1.5K
Control systems are everywhere in contemporary society, influencing diverse applications from aerospace to automated manufacturing. These systems can be found naturally within biological processes, such as blood sugar regulation and heart rate adjustment in response to stress, as well as in man-made systems like elevators and automated vehicles. A control system is essentially a network of subsystems and processes that collaboratively convert specific inputs into desired outputs.
At the heart...
1.5K
Linear Approximation in Time Domain01:21

Linear Approximation in Time Domain

152
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
152
Time-Domain Interpretation of PD Control01:07

Time-Domain Interpretation of PD Control

205
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
205
Transient and Steady-state Response01:24

Transient and Steady-state Response

318
In control systems, test signals are essential for evaluating performance under various conditions. The ramp function is effective for systems undergoing gradual changes, while the step function is suitable for assessing systems facing sudden disturbances. For systems subjected to shock inputs, the impulse function is the most appropriate test signal.
These test signals are integral in designing control systems to exhibit two key performance aspects: transient response and steady-state...
318
Controller Configurations01:22

Controller Configurations

187
Controller configurations are crucial in a car's cruise control system because they manage speed over time to maintain a consistent pace regardless of road conditions, thereby meeting design goals. In traditional control systems, fixed-configuration design involves predetermined controller placement. System performance modifications are known as compensation.
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
187

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Safe Optimal Control Framework for Cooperative Manipulation of Objects in Human-Robot Teams.

IEEE transactions on cybernetics·2026
Same author

Lifelong Learning-Based Optimal Trajectory Tracking Control of Constrained Nonlinear Affine Systems Using Deep Neural Networks.

IEEE transactions on cybernetics·2024
Same author

Optimal Adaptive Tracking Control of Partially Uncertain Nonlinear Discrete-Time Systems Using Lifelong Hybrid Learning.

IEEE transactions on neural networks and learning systems·2023
Same author

Cooperative Deep Q-Learning Framework for Environments Providing Image Feedback.

IEEE transactions on neural networks and learning systems·2023
Same author

QC_SANE: Robust Control in DRL Using Quantile Critic With Spiking Actor and Normalized Ensemble.

IEEE transactions on neural networks and learning systems·2021
Same author

Online Optimal Adaptive Control of Partially Uncertain Nonlinear Discrete-Time Systems Using Multilayer Neural Networks.

IEEE transactions on neural networks and learning systems·2021
Same journal

Hidden Data Recovery and Forecasting via Next-Generation Reservoir Computing With Multiscale Delay Selection.

IEEE transactions on neural networks and learning systems·2026
Same journal

CAFF-CIL: Causality-Aware Freedom Forgetting Approach for Class-Incremental Learning.

IEEE transactions on neural networks and learning systems·2026
Same journal

Harmonic Autoencoding Framework for Multiple Tasks in Magnetic Particle Imaging Reconstruction.

IEEE transactions on neural networks and learning systems·2026
Same journal

A Survey on Human-Centric Voice-Face Multimodal Learning.

IEEE transactions on neural networks and learning systems·2026
Same journal

Vision-Assisted Foundation Model for Solving Multitask Vehicle Routing Problems.

IEEE transactions on neural networks and learning systems·2026
Same journal

FP3O: Enabling Proximal Policy Optimization in Multiagent Cooperation With Parameter-Sharing Versatility.

IEEE transactions on neural networks and learning systems·2026
See all related articles

Related Experiment Video

Updated: Oct 18, 2025

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
08:18

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

Published on: August 15, 2020

5.1K

Optimal Adaptive Control of Uncertain Nonlinear Continuous-Time Systems With Input and State Delays.

Rohollah Moghadam, Sarangapani Jagannathan

    IEEE Transactions on Neural Networks and Learning Systems
    |September 29, 2021
    PubMed
    Summary
    This summary is machine-generated.

    This study introduces an actor-critic neural network for optimal adaptive regulation in nonlinear systems with delays and uncertainty. The method ensures system stability and effective control policy estimation using integral reinforcement learning.

    More Related Videos

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
    06:45

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

    Published on: October 28, 2022

    1.8K
    Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
    11:54

    Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

    Published on: May 8, 2021

    4.7K

    Related Experiment Videos

    Last Updated: Oct 18, 2025

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
    08:18

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

    Published on: August 15, 2020

    5.1K
    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
    06:45

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

    Published on: October 28, 2022

    1.8K
    Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
    11:54

    Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

    Published on: May 8, 2021

    4.7K

    Area of Science:

    • Control Systems Engineering
    • Artificial Intelligence
    • Nonlinear Dynamics

    Background:

    • Online adaptive control is crucial for systems with unknown dynamics and time delays.
    • Actor-critic neural networks offer a powerful framework for complex control problems.
    • Ensuring stability and performance in the presence of uncertainties and delays remains a significant challenge.

    Purpose of the Study:

    • To develop an online optimal adaptive regulation strategy for nonlinear continuous-time systems.
    • To address challenges posed by known state and input delays and uncertain system dynamics.
    • To ensure the stability and effectiveness of the proposed control approach.

    Main Methods:

    • Utilizing an actor-critic neural network architecture for online learning and control.
    • Deriving temporal difference error (TDE) using integral reinforcement learning, accounting for system delays.
    • Implementing a novel identifier to estimate control coefficient matrices for policy refinement.
    • Employing Lyapunov analysis to rigorously prove the boundedness of system states and network parameters.

    Main Results:

    • Successful online optimal adaptive regulation of nonlinear systems with delays and uncertainties.
    • Demonstrated effective estimation of control policies via a novel identifier.
    • Validated the boundedness of critical system components including state vectors, critic NN weights, and identification errors.
    • Simulation results confirm the efficacy of the proposed actor-critic NN-based approach.

    Conclusions:

    • The proposed actor-critic neural network approach provides an effective solution for online optimal adaptive regulation in complex nonlinear systems.
    • Lyapunov analysis confirms the robustness and stability of the control strategy.
    • The method demonstrates significant potential for applications requiring adaptive control under uncertainty and time delays.