Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Approximate Integration01:24

Approximate Integration

157
In many practical and theoretical contexts, the exact value of a definite integral may be inaccessible. This limitation typically arises when the antiderivative of a function is either unknown or cannot be expressed in a closed mathematical form. Alternatively, it can occur when a function is defined not by a formula but by a finite set of empirical data points, such as those collected during experiments. In these cases, approximate integration techniques provide a valuable solution.One of the...
157
Application of Linearization and Approximation01:29

Application of Linearization and Approximation

190
A drone flying through complex terrain often relies on more than one sensing method to estimate small changes in altitude. Along with direct measurements, air pressure provides a useful indirect indicator of vertical movement. Atmospheric pressure decreases as altitude increases, and this relationship is commonly described using an exponential model. Although accurate, converting pressure measurements into altitude values requires calculations that are too complex to perform repeatedly during...
190
Linear Approximation in Frequency Domain01:26

Linear Approximation in Frequency Domain

501
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
501
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

434
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
434
Linear Approximation in Time Domain01:21

Linear Approximation in Time Domain

459
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
459
Convergence of Fourier Series01:21

Convergence of Fourier Series

608
The Fourier series is a powerful mathematical tool for representing periodic signals as an infinite sum of complex exponentials. In practice, this infinite series is truncated to a finite number of terms, yielding a partial sum. This truncation makes the approximation of the signal feasible but introduces certain challenges, particularly near discontinuities, known as the Gibbs phenomenon.
The Gibbs phenomenon refers to the persistent oscillations and overshoots that occur near discontinuities...
608

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Atherosclerotic plaque distribution and characteristics in young patients with stroke/transient ischemic attack: insights from MR vessel wall imaging and comparison with older counterparts.

Quantitative imaging in medicine and surgery·2026
Same author

VisualRNet: Lightweight Camera Rotation Estimation from Low-Resolution Optical Flow via Cross-Modal Supervision.

Sensors (Basel, Switzerland)·2026
Same author

Vasoactive intestinal peptide attenuates form-deprivation myopia in guinea pigs by suppressing the Wnt/β-catenin pathway along the retina-choroid-scleral axis.

Experimental eye research·2026
Same author

Solar-driven rooftop interfacial evaporation system for decentralized rainwater purification.

Water research·2026
Same author

Recent Advances on Off-Policy Reinforcement Learning for Optimization Control.

IEEE transactions on cybernetics·2026
Same author

A two-stage model of Verwey transition in Fe<sub>3</sub>O<sub>4</sub>: first-principles studies.

Physical chemistry chemical physics : PCCP·2026
Same journal

Relaxed Stability Conditions for Model Predictive Control of Hybrid Dynamical Systems Using Hybrid Recurrent Neural Networks.

IEEE transactions on cybernetics·2026
Same journal

An Evolutionary Algorithm Assisted by an Ensemble of Pareto-Optimal Surrogate Models.

IEEE transactions on cybernetics·2026
Same journal

A Quantum Self-Attention Neural Network Model on Quantum Circuits.

IEEE transactions on cybernetics·2026
Same journal

Semi-Explicit Solution of Some Discrete-Time Higher-Order-Cost Mean-Field-Type Control.

IEEE transactions on cybernetics·2026
Same journal

A Novel One-Step Small Object Detector for Autonomous Aerial Vehicles.

IEEE transactions on cybernetics·2026
Same journal

Online Data-Driven-Based Optimal Output Tracking Control Without Initial Stabilizing Policy.

IEEE transactions on cybernetics·2026
See all related articles

Related Experiment Video

Updated: Apr 23, 2026

Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
06:45

Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

Published on: October 28, 2022

1.7K

Finite-approximation-error-based discrete-time iterative adaptive dynamic programming.

Qinglai Wei, Fei-Yue Wang, Derong Liu

    IEEE Transactions on Cybernetics
    |September 30, 2014
    PubMed
    Summary
    This summary is machine-generated.

    A novel adaptive dynamic programming (ADP) algorithm addresses optimal control for nonlinear systems. This method improves convergence using a generalized value iteration and adaptive approximation error design, validated by simulations.

    More Related Videos

    A Tactile Automated Passive-Finger Stimulator TAPS
    19:44

    A Tactile Automated Passive-Finger Stimulator TAPS

    Published on: June 3, 2009

    14.9K

    Related Experiment Videos

    Last Updated: Apr 23, 2026

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
    06:45

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

    Published on: October 28, 2022

    1.7K
    A Tactile Automated Passive-Finger Stimulator TAPS
    19:44

    A Tactile Automated Passive-Finger Stimulator TAPS

    Published on: June 3, 2009

    14.9K

    Area of Science:

    • Control Theory
    • Nonlinear Systems
    • Adaptive Dynamic Programming

    Background:

    • Optimal control problems for infinite horizon discrete-time nonlinear systems are challenging.
    • Traditional value iteration algorithms have limitations in initialization.
    • Finite approximation errors can hinder convergence in iterative algorithms.

    Purpose of the Study:

    • Develop a new iterative adaptive dynamic programming (ADP) algorithm.
    • Address optimal control for nonlinear systems with finite approximation errors.
    • Improve convergence properties of value iteration algorithms.

    Main Methods:

    • Introduced a generalized value iteration algorithm for ADP.
    • Enabled arbitrary positive semi-definite function initialization.
    • Established a novel design method for convergence criteria with finite approximation errors.
    • Utilized neural networks for implementing the iterative ADP algorithm.

    Main Results:

    • The generalized value iteration algorithm ensures convergence to the Hamilton-Jacobi-Bellman equation solution.
    • The adaptive approximation error design allows convergence to a finite neighborhood of the optimal performance index.
    • Simulations demonstrated the effectiveness of the developed ADP method.

    Conclusions:

    • The proposed iterative ADP algorithm effectively solves optimal control problems for nonlinear systems.
    • The generalized value iteration and adaptive convergence criteria overcome limitations of traditional methods.
    • The use of neural networks provides a practical implementation for the developed algorithm.