Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Differential Equations: Problem Solving01:21

Differential Equations: Problem Solving

239
When analyzing the motion of falling objects, it is essential to consider not only the force of gravity but also the opposing force of air resistance. A practical example involves releasing a heavy test weight during a safety check on a ship. As the weight falls from rest, gravity accelerates it downward while air resistance exerts an upward force that increases with velocity. This dynamic interplay of forces is well described by differential equations, which provide a mathematical framework...
239
State Space Representation01:27

State Space Representation

785
The frequency-domain technique, commonly used in analyzing and designing feedback control systems, is effective for linear, time-invariant systems. However, it falls short when dealing with nonlinear, time-varying, and multiple-input multiple-output systems. The time-domain or state-space approach addresses these limitations by utilizing state variables to construct simultaneous, first-order differential equations, known as state equations, for an nth-order system.
Consider an RLC circuit, a...
785
The Power Flow Problem and Solution01:26

The Power Flow Problem and Solution

1.2K
Power flow problem analysis is fundamental for determining real and reactive power flows in network components, such as transmission lines, transformers, and loads. The power system's single-line diagram provides data on the bus, transmission line, and transformer. Each bus k in the system is characterized by four key variables: voltage magnitude Vk​, phase angle δk​, real power Pk​, and reactive power Qk​. Two of these four variables are inputs, while the power...
1.2K
Multimachine Stability01:25

Multimachine Stability

698
Multimachine stability analysis is crucial for understanding the dynamics and stability of power systems with multiple synchronous machines. The objective is to solve the swing equations for a network of M machines connected to an N-bus power system.
In analyzing the system, the nodal equations represent the relationship between bus voltages, machine voltages, and machine currents. The nodal equation is given by:
698
Linear time-invariant Systems01:23

Linear time-invariant Systems

1.1K
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
1.1K
Linear Approximation in Time Domain01:21

Linear Approximation in Time Domain

460
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
460

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Cross-sector deep learning scales life cycle assessment using unified textual descriptions.

Environmental science and ecotechnology·2026
Same author

[Retracted] Acaricidal activity of extracts from <i>Ligularia virgaurea</i> against the <i>Sarcoptes scabiei</i> mite <i>in vitro</i>.

Experimental and therapeutic medicine·2026
Same author

Approximate Optimal Control for Morphing Aircraft via Attention Meta-Learning and Continual Learning.

IEEE transactions on neural networks and learning systems·2026
Same author

Recent Advances on Off-Policy Reinforcement Learning for Optimization Control.

IEEE transactions on cybernetics·2026
Same author

Optimal cooperative output regulation with norm-based performance specifications.

ISA transactions·2026
Same author

DACESR: Degradation-Aware Conditional Embedding for Real-World Image Super-Resolution.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026

Related Experiment Video

Updated: Apr 30, 2026

Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
06:45

Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

Published on: October 28, 2022

1.7K

Neural network based online simultaneous policy update algorithm for solving the HJI equation in nonlinear H∞

Huai-Ning Wu, Biao Luo

    IEEE Transactions on Neural Networks and Learning Systems
    |May 9, 2014
    PubMed
    Summary

    A novel neural network algorithm solves the complex Hamilton-Jacobi-Isaacs equation for nonlinear H∞ control without needing system dynamics. This reinforcement learning approach enables simultaneous policy updates for efficient control and disturbance management.

    Related Experiment Videos

    Last Updated: Apr 30, 2026

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
    06:45

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

    Published on: October 28, 2022

    1.7K

    Area of Science:

    • Control Theory
    • Artificial Intelligence
    • Applied Mathematics

    Background:

    • The nonlinear H∞ state feedback control problem necessitates solving the Hamilton-Jacobi-Isaacs (HJI) equation.
    • The HJI equation is a nonlinear partial differential equation that is analytically intractable.
    • Existing methods often require knowledge of internal system dynamics, which is not always available.

    Purpose of the Study:

    • To develop a neural network (NN)-based online simultaneous policy update algorithm (SPUA) to solve the HJI equation.
    • To address the challenge of solving the HJI equation without requiring internal system dynamics knowledge.
    • To provide an efficient and convergent algorithm for nonlinear H∞ control.

    Main Methods:

    • An online simultaneous policy update algorithm (SPUA) is proposed, framed as a reinforcement learning technique for two-player optimal action learning in unknown environments.
    • The algorithm updates control and disturbance policies concurrently within a single iterative loop.
    • An actor-critic structure is implemented, utilizing a single critic NN for cost function approximation and a least-squares method for NN weight parameter estimation.

    Main Results:

    • The convergence of the online SPUA is mathematically established, demonstrating its equivalence to Newton's method for fixed-point finding in a Banach space.
    • The proposed method effectively solves the HJI equation without prior knowledge of system dynamics.
    • Simulation studies confirm the algorithm's effectiveness in practical applications.

    Conclusions:

    • The developed NN-based online SPUA offers a viable and efficient solution for the nonlinear H∞ state feedback control problem.
    • The algorithm's convergence guarantees and its ability to operate without system dynamics knowledge make it a significant advancement.
    • The actor-critic implementation with least-squares estimation provides a practical framework for applying this technique.