Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Linear Approximation in Time Domain01:21

Linear Approximation in Time Domain

Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length, the...
Feedback control systems01:26

Feedback control systems

Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Linear Approximation in Frequency Domain01:26

Linear Approximation in Frequency Domain

Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear.
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
Linearization and Approximation01:26

Linearization and Approximation

Linearization is a mathematical technique used to approximate complex, nonlinear functions with simpler linear models in the vicinity of a chosen reference point. The method is based on the idea that, although a function may be difficult to evaluate exactly, its behavior near a specific input value can often be closely approximated by the tangent line at that point. This approach is particularly useful when small deviations from a known value are involved.Consider the square root function, for...
Time-Domain Interpretation of PD Control01:07

Time-Domain Interpretation of PD Control

Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Recent Advances on Off-Policy Reinforcement Learning for Optimization Control.

IEEE transactions on cybernetics·2026
Same author

Attack Detection and Active Attack Defense for Cyber-Physical Systems via Zonotopic Observer and Reachability Analysis.

IEEE transactions on cybernetics·2026
Same author

Federated Learning Adaptive Dynamic Programming for Massive Multiagent Mean-Field Games-Based Optimal Consensus.

IEEE transactions on cybernetics·2025
Same author

Cross-linked genes analysis of programmed cell death and network pharmacological validation after spinal cord injury.

Biochemical and biophysical research communications·2025
Same author

Design Strategies and Advanced Methods for Cathode Engineering in Aqueous Zinc-Iodine Batteries.

Small methods·2025
Same author

FX-DARTS: Designing Topology-Unconstrained Architectures With Differentiable Architecture Search and Entropy-BasedSuper-Network Shrinking.

IEEE transactions on neural networks and learning systems·2025
Same journal

A New Human-Likeness and Comfort Index for Robot Movements Along Prescribed Paths.

IEEE transactions on cybernetics·2026
Same journal

Robust Semiglobal and Global Stabilization for Nonlinear Normal Form Systems by Time-Varying Feedback.

IEEE transactions on cybernetics·2026
Same journal

Adaptive Global Asymptotic Output Stabilization of Uncertain Nonlinear Systems Under Dynamic State/Input Quantization.

IEEE transactions on cybernetics·2026
Same journal

Accelerated Distributed Gradient Tracking for Constrained Aggregative Optimization Over Time-Varying Digraphs.

IEEE transactions on cybernetics·2026
Same journal

Small-Gain-Based Plug-and-Play Distributed Control Framework for DC Microgrids With Decentralized Reconfiguration.

IEEE transactions on cybernetics·2026
Same journal

Prescribed-Time Impulsive Control of High-Order Integrator Systems.

IEEE transactions on cybernetics·2026
See all related articles

Related Experiment Video

Updated: May 17, 2026

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
08:18

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

Published on: August 15, 2020

Finite-Approximation-Error-Based Optimal Control Approach for Discrete-Time Nonlinear Systems.

Derong Liu, Qinglai Wei

    IEEE Transactions on Cybernetics
    |October 17, 2012
    PubMed
    Summary
    This summary is machine-generated.

    A novel iterative adaptive dynamic programming (ADP) algorithm addresses optimal control for nonlinear systems. This method ensures convergence to optimal performance despite approximation errors, utilizing neural networks for implementation.

    Related Experiment Videos

    Last Updated: May 17, 2026

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
    08:18

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

    Published on: August 15, 2020

    Area of Science:

    • Control Theory
    • Nonlinear Systems
    • Adaptive Dynamic Programming

    Background:

    • Optimal control problems for infinite-horizon discrete-time nonlinear systems are challenging due to complexity and approximation errors.
    • Existing methods may struggle with convergence guarantees in the presence of finite approximation errors.

    Purpose of the Study:

    • To develop a new iterative adaptive dynamic programming (ADP) algorithm for solving optimal control problems in nonlinear systems.
    • To ensure convergence of the iterative performance index function to the optimal value, even with finite approximation errors.

    Main Methods:

    • An iterative adaptive dynamic programming (ADP) algorithm is proposed.
    • The algorithm uses neural networks to approximate the performance index function and compute the optimal control policy.
    • Convergence conditions for the iterative ADP algorithm are derived and analyzed.

    Main Results:

    • The iterative ADP algorithm yields an iterative control law that optimizes the performance index function.
    • Under mild assumptions and satisfied convergence conditions, the iterative performance index functions converge to a finite neighborhood of the greatest lower bound.
    • Simulation examples demonstrate the effectiveness of the proposed method.

    Conclusions:

    • The developed iterative ADP algorithm provides a robust approach for optimal control of nonlinear systems with approximation errors.
    • The use of neural networks facilitates practical implementation and demonstrates the algorithm's performance.
    • The study establishes convergence properties, offering theoretical support for the method's applicability.