Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

109
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
109
Statically Indeterminate Problem Solving01:16

Statically Indeterminate Problem Solving

512
Statically indeterminate problems are those where statics alone can not determine the internal forces or reactions. Consider a structure comprising two cylindrical rods made of steel and brass. These rods are joined at point B and restrained by rigid supports at points A and C. Now, the reactions at points A and C and the deflection at point B are to be determined. This rod structure is classified as statically indeterminate as the structure has more supports than are necessary for maintaining...
512
Fast Decoupled and DC Powerflow01:24

Fast Decoupled and DC Powerflow

312
The fast decoupled power flow method addresses contingencies in power system operations, such as generator outages or transmission line failures. This method provides quick power flow solutions, essential for real-time system adjustments. Fast decoupled power flow algorithms simplify the Jacobian matrix by neglecting certain elements, leading to two sets of decoupled equations:
312
Decision Making: P-value Method01:09

Decision Making: P-value Method

5.8K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim  is also stated. These statements can act as null and alternative hypotheses:  a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.8K
First Order Systems01:21

First Order Systems

170
First-order systems, such as RC circuits, are foundational in understanding dynamic systems due to their straightforward input-output relationship. Analyzing their responses to different input functions under zero initial conditions reveals significant insights into system behavior.
When a first-order system is subjected to a unit-step input, its response is characterized by its transfer function. By applying the Laplace transform of the unit-step input to the transfer function, expanding the...
170
Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

178
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
178

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Recent Advances on Off-Policy Reinforcement Learning for Optimization Control.

IEEE transactions on cybernetics·2026
Same author

Configurational pathways to pediatric e-bike injury severity: an fsQCA study of global evidence.

Frontiers in public health·2026
Same author

Federated Learning Adaptive Dynamic Programming for Massive Multiagent Mean-Field Games-Based Optimal Consensus.

IEEE transactions on cybernetics·2025
Same author

Cross-linked genes analysis of programmed cell death and network pharmacological validation after spinal cord injury.

Biochemical and biophysical research communications·2025
Same author

Design Strategies and Advanced Methods for Cathode Engineering in Aqueous Zinc-Iodine Batteries.

Small methods·2025
Same author

FX-DARTS: Designing Topology-Unconstrained Architectures With Differentiable Architecture Search and Entropy-BasedSuper-Network Shrinking.

IEEE transactions on neural networks and learning systems·2025
Same journal

An Evolutionary Algorithm Assisted by an Ensemble of Pareto-Optimal Surrogate Models.

IEEE transactions on cybernetics·2026
Same journal

A Quantum Self-Attention Neural Network Model on Quantum Circuits.

IEEE transactions on cybernetics·2026
Same journal

Semi-Explicit Solution of Some Discrete-Time Higher-Order-Cost Mean-Field-Type Control.

IEEE transactions on cybernetics·2026
Same journal

A Novel One-Step Small Object Detector for Autonomous Aerial Vehicles.

IEEE transactions on cybernetics·2026
Same journal

Online Data-Driven-Based Optimal Output Tracking Control Without Initial Stabilizing Policy.

IEEE transactions on cybernetics·2026
Same journal

Digital Redesign-Based Interval State Estimation for Continuous Systems With Aperiodic Discrete Measurements.

IEEE transactions on cybernetics·2026
See all related articles

Related Experiment Video

Updated: Sep 28, 2025

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy
11:53

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy

Published on: October 14, 2017

11.8K

An Efficient Impulsive Adaptive Dynamic Programming Algorithm for Stochastic Systems.

Mingming Liang, Yonghua Wang, Derong Liu

    IEEE Transactions on Cybernetics
    |April 5, 2022
    PubMed
    Summary
    This summary is machine-generated.

    Researchers developed new algorithms for optimal impulsive control in discrete stochastic systems. These methods, Impulsive Adaptive Dynamic Programming (IADP) and an efficient variant (EIADP), ensure convergence and adapt to hardware constraints.

    More Related Videos

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
    06:45

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

    Published on: October 28, 2022

    1.8K
    Inherent Dynamics Visualizer, an Interactive Application for Evaluating and Visualizing Outputs from a Gene Regulatory Network Inference Pipeline
    10:44

    Inherent Dynamics Visualizer, an Interactive Application for Evaluating and Visualizing Outputs from a Gene Regulatory Network Inference Pipeline

    Published on: December 7, 2021

    2.3K

    Related Experiment Videos

    Last Updated: Sep 28, 2025

    The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy
    11:53

    The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy

    Published on: October 14, 2017

    11.8K
    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
    06:45

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

    Published on: October 28, 2022

    1.8K
    Inherent Dynamics Visualizer, an Interactive Application for Evaluating and Visualizing Outputs from a Gene Regulatory Network Inference Pipeline
    10:44

    Inherent Dynamics Visualizer, an Interactive Application for Evaluating and Visualizing Outputs from a Gene Regulatory Network Inference Pipeline

    Published on: December 7, 2021

    2.3K

    Area of Science:

    • Control Theory
    • Stochastic Systems
    • Dynamic Programming

    Background:

    • Traditional control methods often struggle with discrete stochastic systems and impulsive events.
    • Existing algorithms may lack efficiency or adaptability for systems with varying computational resources.

    Purpose of the Study:

    • To introduce a novel general impulsive transition matrix for analyzing system dynamics.
    • To develop and validate the Impulsive Adaptive Dynamic Programming (IADP) and Efficient IADP (EIADP) algorithms for optimal impulsive control.
    • To ensure algorithm convergence and adaptability to hardware constraints.

    Main Methods:

    • Definition of a general impulsive transition matrix to capture state transitions between impulsive events.
    • Development of policy iteration-based IADP and EIADP algorithms for discrete stochastic systems.
    • Analysis of monotonicity, stability, and convergence properties of the developed algorithms.

    Main Results:

    • Proof of convergence for both IADP and EIADP algorithms to the optimal impulsive performance index function.
    • Demonstration that EIADP updates policies in a 'piece-by-piece' manner, optimizing for hardware constraints.
    • Validation of the proposed methods' effectiveness through a simulation experiment.

    Conclusions:

    • The IADP and EIADP algorithms effectively solve optimal impulsive control problems in discrete stochastic systems.
    • EIADP offers enhanced efficiency and adaptability, making it suitable for devices with limited memory.
    • The novel impulsive transition matrix provides a robust framework for analyzing system state evolution.