Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Linear Approximation in Time Domain01:21

Linear Approximation in Time Domain

Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length, the...
Time-Domain Interpretation of PD Control01:07

Time-Domain Interpretation of PD Control

Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
Feedback control systems01:26

Feedback control systems

Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Linear Approximation in Frequency Domain01:26

Linear Approximation in Frequency Domain

Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear.
PD Controller: Design01:26

PD Controller: Design

In automotive engineering, car suspension systems often employ Proportional Derivative (PD) controllers to enhance performance. PD controllers are utilized to adjust the damping force in response to road conditions. A controller, acting as an amplifier with a constant gain, demonstrates proportional control, with output directly mirroring input.
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
Control Systems01:10

Control Systems

Control systems are everywhere in contemporary society, influencing diverse applications from aerospace to automated manufacturing. These systems can be found naturally within biological processes, such as blood sugar regulation and heart rate adjustment in response to stress, as well as in man-made systems like elevators and automated vehicles. A control system is essentially a network of subsystems and processes that collaboratively convert specific inputs into desired outputs.
At the heart...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Lyophilizable Thermostable Nano-Aluminum Adjuvant and Combinations Induced Robust Antigen-Specific Humoral and Cellular Immunity in Mice.

Advanced healthcare materials·2026
Same author

Coaxial Hybrid Ionization-Mass Cytometry for High-Throughput and High-Coverage Single-Cell Metabolomics.

Analytical chemistry·2026
Same author

Anti-Disturbance Intermediate Observer-Based Fault Estimation and Fault-Tolerant Control for Markovian Jump Systems.

IEEE transactions on cybernetics·2026
Same author

Multi-endpoint in vitro toxicity profiling of heated tobacco products versus e-cigarettes under air-liquid interface exposure.

Toxicology in vitro : an international journal published in association with BIBRA·2026
Same author

An-Gong-Niu-Huang-Wan ameliorates neurovascular uncoupling and facilitates recovery after cerebral ischemic stroke by mediating P2X7 receptor inhibition.

Phytomedicine : international journal of phytotherapy and phytopharmacology·2026
Same author

Intravenous human umbilical cord-derived mesenchymal stem cell transplantation for ischemic stroke (MERIT): A phase 1 trial.

Cell reports. Medicine·2026
Same journal

Universal perceptron and DNA-like learning algorithm for binary neural networks: LSBF and PBF implementations.

IEEE transactions on neural networks·2013
Same journal

Guest editorial: special section on white box nonlinear prediction models.

IEEE transactions on neural networks·2011
Same journal

Data-based fault-tolerant control of high-speed trains with traction/braking notch nonlinearities and actuator failures.

IEEE transactions on neural networks·2011
Same journal

Guest editorial: special section on data-based control, modeling, and optimization.

IEEE transactions on neural networks·2011
Same journal

Neural network-based multiple robot simultaneous localization and mapping.

IEEE transactions on neural networks·2011
Same journal

Data-driven model-free adaptive control for a class of MIMO nonlinear discrete-time systems.

IEEE transactions on neural networks·2011
See all related articles

Related Experiment Video

Updated: May 28, 2026

Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
06:45

Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

Published on: October 28, 2022

Data-driven robust approximate optimal tracking control for unknown general nonlinear systems using adaptive dynamic

Huaguang Zhang1, Lili Cui, Xin Zhang

  • 1School of Information Science and Engineering, Northeastern University, Shenyang 110004, China. hgzhang@ieee.org

IEEE Transactions on Neural Networks
|October 15, 2011
PubMed
Summary
This summary is machine-generated.

This paper introduces a new control strategy for complex systems where the internal mechanics are unknown. By using only input and output data, a neural network learns the system behavior, while an adaptive algorithm calculates the best possible tracking path. The approach ensures the system stays stable and follows desired targets accurately, even when faced with modeling inaccuracies.

Keywords:
recurrent neural networkoptimal tracking controlrobust stability analysisdata-driven modeling

Frequently Asked Questions

More Related Videos

Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques
09:01

Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques

Published on: April 4, 2017

Related Experiment Videos

Last Updated: May 28, 2026

Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
06:45

Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

Published on: October 28, 2022

Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques
09:01

Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques

Published on: April 4, 2017

Area of Science:

  • Control systems engineering within adaptive dynamic programming research
  • Nonlinear dynamics and computational intelligence

Background:

Engineers often struggle to manage complex systems when the underlying mathematical models remain entirely hidden from view. Prior research has shown that traditional control strategies frequently rely on precise knowledge of system dynamics. That uncertainty drove the development of data-driven approaches to bypass the need for explicit physical modeling. No prior work had resolved the challenge of maintaining optimal performance while simultaneously ensuring robustness against approximation errors. This gap motivated the exploration of adaptive techniques that learn directly from observed input and output signals. Researchers have previously utilized various neural network architectures to approximate unknown functions within these dynamic environments. However, many existing frameworks fail to guarantee that modeling discrepancies vanish during the learning process. This study addresses these limitations by integrating a novel error-correction mechanism into the control architecture.

Purpose Of The Study:

The aim of this study is to develop a robust approximate optimal tracking control scheme for unknown general nonlinear systems. Researchers seek to overcome the challenge of designing controllers when the internal dynamics of a system remain completely hidden. This problem is significant because traditional methods often require precise mathematical models that are difficult to obtain in practice. The motivation stems from the need for a flexible control architecture that relies solely on observable input and output data. By utilizing an adaptive dynamic programming method, the authors intend to approximate optimal control laws without prior system knowledge. The study addresses the difficulty of maintaining stability while simultaneously minimizing approximation errors during the learning phase. A secondary goal involves ensuring that the resulting control input remains close to the theoretical optimum. This research seeks to provide a comprehensive solution for tracking performance in complex, black-box environments.

Main Methods:

The review approach involves establishing a data-driven model using a recurrent neural network to map system behaviors. This design requires only available input-output signals rather than predefined mathematical equations. The researchers incorporate an adjustable term specifically designed to force modeling errors toward zero during operation. An adaptive dynamic programming algorithm then calculates the optimal feedback and steady-state control components. To ensure reliability, the team develops a robustifying term that compensates for approximation discrepancies introduced by the neural network. Stability verification relies on the Lyapunov approach to confirm the closed-loop system behaves predictably. Two numerical simulations serve as the primary validation tools to test the effectiveness of the proposed architecture. This methodology prioritizes data-centric learning to overcome the absence of explicit system knowledge.

Main Results:

Key findings from the literature indicate that the proposed scheme guarantees asymptotic tracking of the desired trajectory for unknown nonlinear systems. The modeling error is successfully driven to zero through the implementation of the novel adjustable correction term. The control input is proven to remain within a small, defined bound of the theoretical optimal control input. Stability analysis confirms that the closed-loop system maintains a stable state throughout the tracking process. The recurrent neural network effectively reconstructs the hidden dynamics using only the available input-output data. Numerical examples demonstrate that the controller performs reliably across the tested scenarios. The robustifying term effectively mitigates the approximation errors generated by the neural network during the adaptive process. These results show that the combination of adaptive dynamic programming and neural networks provides a high level of control precision.

Conclusions:

The authors demonstrate that their proposed scheme successfully achieves asymptotic tracking of desired trajectories for unknown nonlinear systems. Synthesis and implications suggest that the integration of a robustifying term effectively mitigates residual approximation errors. The researchers confirm that the control input remains bounded within a small proximity of the theoretical optimal value. Stability analysis confirms that the closed-loop configuration maintains consistent performance throughout the operation. The study highlights the utility of recurrent neural networks in reconstructing hidden system dynamics from limited data sets. These findings imply that adaptive dynamic programming provides a viable pathway for managing complex, black-box environments. The evidence supports the claim that modeling errors can be driven to zero through the inclusion of adjustable correction terms. This work offers a robust framework for future applications requiring precise tracking in the absence of complete system information.

The researchers propose a dual-layer architecture combining a recurrent neural network for system reconstruction and an adaptive dynamic programming algorithm for feedback regulation. This mechanism ensures the system state follows a target path while minimizing control effort through iterative optimization.

A recurrent neural network serves as the core component for learning system dynamics. This tool processes observed input-output pairs to build an internal representation, allowing the controller to function without explicit knowledge of the underlying physical equations.

Stability analysis via the Lyapunov approach is necessary to guarantee that the closed-loop system remains bounded. This mathematical framework confirms that the state trajectory converges to the desired path, preventing divergence during the learning phase.

Input-output data acts as the primary information source for the recurrent neural network. This data type allows the model to reconstruct system behavior, while the robustifying term compensates for approximation errors inherent in the neural network training process.

The researchers measure the convergence of modeling errors to zero and the proximity of the control input to the theoretical optimum. These metrics demonstrate the effectiveness of the scheme compared to standard controllers that lack robustifying terms.

The authors claim that their approach provides a reliable method for tracking in nonlinear systems where physical modeling is impossible. They suggest that this framework effectively balances optimality with robustness, offering a practical solution for real-world engineering challenges.