Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Linear Approximation in Frequency Domain01:26

Linear Approximation in Frequency Domain

120
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
120
Linear time-invariant Systems01:23

Linear time-invariant Systems

313
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
313
Feedback control systems01:26

Feedback control systems

358
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
358
BIBO stability of continuous and discrete -time systems01:24

BIBO stability of continuous and discrete -time systems

466
System stability is a fundamental concept in signal processing, often assessed using convolution. For a system to be considered bounded-input bounded-output (BIBO) stable, any bounded input signal must produce a bounded output signal. A bounded input signal is one where the modulus does not exceed a certain constant at any point in time.
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
466
Linear Approximation in Time Domain01:21

Linear Approximation in Time Domain

110
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
110
Convolution: Math, Graphics, and Discrete Signals01:24

Convolution: Math, Graphics, and Discrete Signals

324
In any LTI (Linear Time-Invariant) system, the convolution of two signals is denoted using a convolution operator, assuming all initial conditions are zero. The convolution integral can be divided into two parts: the zero-input or natural response and the zero-state or forced response, with t0 indicating the initial time.
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
324

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Anti-Disturbance Intermediate Observer-Based Fault Estimation and Fault-Tolerant Control for Markovian Jump Systems.

IEEE transactions on cybernetics·2026
Same author

A novel dynamic signal Lemma for predefined-time stabilization of high-order nonlinear systems with dynamic uncertainties.

Neural networks : the official journal of the International Neural Network Society·2026
Same author

Observer-Based Fuzzy Secure Control for High-Order MASs Against Communication Delays Under Jointly Connected Switching Topology.

IEEE transactions on cybernetics·2026
Same author

Optimal Containment Control for Stochastic Multiagent Systems via Simplified ADP Under Secure Communication.

IEEE transactions on cybernetics·2026
Same author

Constraint-Based Fuzzy Adaptive Security Formation Control for Nonlinear Multiagent Systems Against Deception Attacks.

IEEE transactions on cybernetics·2025
Same author

Adaptive Bipartite Hybrid Event-Triggered Output Consensus of Heterogeneous Uncertain Multiagent Systems Under Fixed and Switching Topologies.

IEEE transactions on cybernetics·2025
Same journal

Relaxed Stability Conditions for Model Predictive Control of Hybrid Dynamical Systems Using Hybrid Recurrent Neural Networks.

IEEE transactions on cybernetics·2026
Same journal

An Evolutionary Algorithm Assisted by an Ensemble of Pareto-Optimal Surrogate Models.

IEEE transactions on cybernetics·2026
Same journal

A Quantum Self-Attention Neural Network Model on Quantum Circuits.

IEEE transactions on cybernetics·2026
Same journal

Semi-Explicit Solution of Some Discrete-Time Higher-Order-Cost Mean-Field-Type Control.

IEEE transactions on cybernetics·2026
Same journal

A Novel One-Step Small Object Detector for Autonomous Aerial Vehicles.

IEEE transactions on cybernetics·2026
Same journal

Online Data-Driven-Based Optimal Output Tracking Control Without Initial Stabilizing Policy.

IEEE transactions on cybernetics·2026
See all related articles

Related Experiment Video

Updated: Aug 4, 2025

Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
06:45

Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

Published on: October 28, 2022

1.7K

Convergence Analysis of Value Iteration Adaptive Dynamic Programming for Continuous-Time Nonlinear Systems.

Geyang Xiao, Huaguang Zhang

    IEEE Transactions on Cybernetics
    |April 5, 2023
    PubMed
    Summary
    This summary is machine-generated.

    This study analyzes value iteration (VI) for continuous-time (CT) nonlinear systems, proving convergence and deriving error bounds for adaptive dynamic programming. Simulation results validate the theoretical findings.

    More Related Videos

    An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces
    10:51

    An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces

    Published on: March 10, 2011

    13.8K
    Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques
    09:01

    Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques

    Published on: April 4, 2017

    8.7K

    Related Experiment Videos

    Last Updated: Aug 4, 2025

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
    06:45

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

    Published on: October 28, 2022

    1.7K
    An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces
    10:51

    An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces

    Published on: March 10, 2011

    13.8K
    Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques
    09:01

    Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques

    Published on: April 4, 2017

    8.7K

    Area of Science:

    • Control Theory
    • Adaptive Dynamic Programming
    • Nonlinear Systems

    Background:

    • Adaptive dynamic programming (ADP) is crucial for solving complex control problems.
    • Convergence and error analysis of value iteration (VI) in continuous-time (CT) nonlinear systems remain challenging.
    • Understanding the impact of approximation errors is vital for practical ADP implementation.

    Purpose of the Study:

    • To analyze the convergence property of value iteration (VI) for continuous-time (CT) nonlinear systems.
    • To derive error bounds for VI adaptive dynamic programming considering approximation errors.
    • To propose a method for estimating the contraction assumption for practical application.

    Main Methods:

    • Assumed a contraction property relating the total value function and single integral step cost.
    • Proved the convergence of VI with arbitrary positive semidefinite initial conditions.
    • Incorporated accumulated approximation errors into the analysis and derived error bounds.

    Main Results:

    • Established the convergence of VI for CT nonlinear systems under a contraction assumption.
    • Derived conditions for error bounds, ensuring approximated results converge near the optimum.
    • Provided a method to estimate the contraction assumption's conservative value.

    Conclusions:

    • The theoretical results confirm the convergence and provide quantifiable error bounds for VI in CT nonlinear systems.
    • The proposed estimation method for the contraction assumption enhances the practical applicability of the findings.
    • Simulation cases validate the effectiveness of the developed theoretical framework.