Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

State Space Representation01:27

State Space Representation

464
The frequency-domain technique, commonly used in analyzing and designing feedback control systems, is effective for linear, time-invariant systems. However, it falls short when dealing with nonlinear, time-varying, and multiple-input multiple-output systems. The time-domain or state-space approach addresses these limitations by utilizing state variables to construct simultaneous, first-order differential equations, known as state equations, for an nth-order system.
Consider an RLC circuit, a...
464
Feedback control systems01:26

Feedback control systems

620
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
620
Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

325
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
325
Open and closed-loop control systems01:17

Open and closed-loop control systems

1.4K
Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
1.4K
Linear time-invariant Systems01:23

Linear time-invariant Systems

791
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
791
Linear Approximation in Time Domain01:21

Linear Approximation in Time Domain

269
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
269

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Review of NEDDylation inhibition activity detection methods.

Bioorganic & medicinal chemistry·2020
Same author

Optimization of Process Parameters of Rhamnolipid Treatment of Oily Sludge Based on Response Surface Methodology.

ACS omega·2020
Same author

Safety and Long-term Scleral Biomechanical Stability of Rhesus Eyes after Scleral Cross-linking by Blue Light.

Current eye research·2020
Same author

Serum pentraxin 3 as a biomarker for prognosis of acute minor stroke due to large artery atherosclerosis.

Brain and behavior·2020
Same author

The roles of adenosine deaminase in autoimmune diseases.

Autoimmunity reviews·2020
Same author

The role of oxidative stress in association between disinfection by-products exposure and semen quality: A mediation analysis among men from an infertility clinic.

Chemosphere·2020

Related Experiment Video

Updated: Dec 21, 2025

Interactive and Visualized Online Experimentation System for Engineering Education and Research
08:35

Interactive and Visualized Online Experimentation System for Engineering Education and Research

Published on: November 24, 2021

2.9K

Dual Heuristic Programming for Optimal Control of Continuous-Time Nonlinear Systems Using Single Echo State Network.

Chong Liu, Huaguang Zhang, Yanhong Luo

    IEEE Transactions on Cybernetics
    |May 13, 2020
    PubMed
    Summary
    This summary is machine-generated.

    This study introduces an advanced adaptive dynamic programming algorithm for optimal control of nonlinear systems. It uses an echo state network to efficiently solve complex control problems without needing initial control inputs.

    More Related Videos

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
    06:45

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

    Published on: October 28, 2022

    2.0K
    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
    08:18

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

    Published on: August 15, 2020

    5.3K

    Related Experiment Videos

    Last Updated: Dec 21, 2025

    Interactive and Visualized Online Experimentation System for Engineering Education and Research
    08:35

    Interactive and Visualized Online Experimentation System for Engineering Education and Research

    Published on: November 24, 2021

    2.9K
    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
    06:45

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

    Published on: October 28, 2022

    2.0K
    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
    08:18

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

    Published on: August 15, 2020

    5.3K

    Area of Science:

    • Control Systems Engineering
    • Artificial Intelligence
    • Nonlinear Dynamics

    Background:

    • Optimal control of continuous-time nonlinear systems is challenging.
    • Traditional methods often require complex system models or initial admissible controls.
    • Adaptive dynamic programming (ADP) offers a data-driven approach but faces computational hurdles.

    Purpose of the Study:

    • To develop an improved online adaptive dynamic programming (ADP) algorithm for infinite horizon optimal control.
    • To address the limitations of existing ADP methods, particularly the need for initial admissible control.
    • To enhance the efficiency and applicability of ADP for continuous-time nonlinear systems.

    Main Methods:

    • Utilized a novel critic-only structure based on a single Echo State Network (ESN) to approximate the Hamilton-Jacobi-Bellman (HJB) equation.
    • Employed the Echo State Property (ESP) of ESN for accurate HJB solution approximation.
    • Introduced a new weight tuning law to remove the requirement for an initial admissible control.
    • Applied Lyapunov stability theory to guarantee system stability and convergence.

    Main Results:

    • The proposed ESN-based critic-only structure effectively approximates the HJB equation solution.
    • The new weight tuning law successfully eliminates the need for an initial admissible control.
    • Stability of the closed-loop system and convergence of ESN weights are proven (uniformly ultimately bounded).
    • Simulation results demonstrate superior performance compared to a polynomial neural-network scheme.

    Conclusions:

    • The improved online ADP algorithm using ESN is effective for optimal control of continuous-time nonlinear systems.
    • The approach offers a robust and efficient solution, overcoming key limitations of prior methods.
    • The findings have significant implications for advanced control applications in various engineering domains.