Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Linear Approximation in Time Domain01:21

Linear Approximation in Time Domain

423
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
423
Feedback control systems01:26

Feedback control systems

800
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
800
Time-Domain Interpretation of PD Control01:07

Time-Domain Interpretation of PD Control

445
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
445
PD Controller: Design01:26

PD Controller: Design

723
In automotive engineering, car suspension systems often employ Proportional Derivative (PD) controllers to enhance performance. PD controllers are utilized to adjust the damping force in response to road conditions. A controller, acting as an amplifier with a constant gain, demonstrates proportional control, with output directly mirroring input.
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
723
PI Controller: Design01:24

PI Controller: Design

1.5K
Proportional Integral (PI) controllers are a fundamental component in modern control systems, widely used to enhance performance and mitigate steady-state errors. They are particularly effective in applications such as automatic brightness adjustment on smartphones, where they excel at mitigating steady-state errors for step-function inputs. Unlike PD controllers, which require time-varying errors to function optimally, PI controllers leverage their integral component to address residual...
1.5K
Time and frequency -Domain Interpretation of PI Control01:27

Time and frequency -Domain Interpretation of PI Control

484
Proportional-Integral (PI) controllers are essential in many control systems to improve stability and performance. They are commonly used in everyday devices like thermostats to enhance system damping and reduce steady-state error. When the zero in the controller's transfer function is optimally placed, the system benefits significantly in terms of stability and accuracy.
Acting as a low-pass filter, the PI controller slows the system's response and extends settling times. This requires...
484

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Perching of quadrotor using adaptive second-order continuous control in the presence of uncertainties.

Scientific reports·2026
Same author

Self-reflection, sense of agency, and underlying neural correlates: A pilot study.

PloS one·2025
Same author

A Hierarchical Cascade of Organellar Silencing and Their Regeneration Under Anaesthetic Stress in Plants.

Advanced biology·2025
Same author

EEG microstates dynamics of happiness and sadness during music listening.

Frontiers in human neuroscience·2025
Same author

A comparative study of EEG microstate dynamics during happy and sad music videos.

Frontiers in human neuroscience·2025
Same author

Non-local interaction in discrete Ricci curvature-induced biological aggregation.

Royal Society open science·2024
Same journal

Intervention Feasible Region and Driver Risk Capacity Aware Human-Machine Collaborative Safe Trajectory Planning.

IEEE transactions on neural networks and learning systems·2026
Same journal

A Unified Differential Denoising Learning Framework With a Pre-Trained Model and Fuzzy Graph Networks for Drug-Drug Interaction Prediction.

IEEE transactions on neural networks and learning systems·2026
Same journal

Self-Supervised Continuous Dynamic Graph Representation Learning via Hawkes Processes.

IEEE transactions on neural networks and learning systems·2026
Same journal

cPU: Consistent Risk Estimator for Positive-Unlabeled Learning.

IEEE transactions on neural networks and learning systems·2026
Same journal

Tuning-Free Latent Diffusion Models for Ultrahigh-Resolution Image Editing.

IEEE transactions on neural networks and learning systems·2026
Same journal

Hidden Data Recovery and Forecasting via Next-Generation Reservoir Computing With Multiscale Delay Selection.

IEEE transactions on neural networks and learning systems·2026
See all related articles

Related Experiment Video

Updated: Apr 5, 2026

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
08:18

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

Published on: August 15, 2020

5.5K

Near-Optimal Controller for Nonlinear Continuous-Time Systems With Unknown Dynamics Using Policy Iteration.

Samrat Dutta, Prem Kumar Patchaikani, Laxmidhar Behera

    IEEE Transactions on Neural Networks and Learning Systems
    |August 11, 2015
    PubMed
    Summary
    This summary is machine-generated.

    This study introduces a novel adaptive critic control method for systems with unknown dynamics. It ensures policy stability during training, unlike previous approaches, and was validated on a robotic manipulator.

    Related Experiment Videos

    Last Updated: Apr 5, 2026

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
    08:18

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

    Published on: August 15, 2020

    5.5K

    Area of Science:

    • Control Systems Engineering
    • Artificial Intelligence
    • Robotics

    Background:

    • Policy iteration (PI) frameworks are used for adaptive control but can face instability issues due to critic network parameter updates.
    • Estimating unknown system dynamics using Takagi-Sugeno-Kang fuzzy models is feasible with high precision.
    • Existing literature on PI convergence often overlooks the critical impact of critic network parameters on stability.

    Purpose of the Study:

    • To develop a stable adaptive critic-based controller for continuous-time systems with unknown dynamics.
    • To propose a novel critic network parameter update scheme that ensures system stability throughout the policy iteration process.
    • To reduce the computational complexity of adaptive critic control algorithms.

    Main Methods:

    • A single-network adaptive critic-based controller is implemented within a policy iteration (PI) framework.
    • Unknown system dynamics are approximated using a Takagi-Sugeno-Kang fuzzy model.
    • A novel critic network parameter update scheme combines Lyapunov-based linear matrix inequalities with PI to ensure policy stability.
    • A genetic algorithm is employed to search for stable parameters and minimize training error.

    Main Results:

    • The proposed method successfully approximates the critic and ensures policy stability in each PI iteration.
    • A significant reduction in computational complexity to the order of (Fz)(n-1) is achieved.
    • The algorithm effectively finds initial stable control policies.
    • Real-time experiments on a robotic manipulator validated the algorithm's ability to find stable critic parameters for nonlinear systems.

    Conclusions:

    • The novel critic network parameter update scheme overcomes the instability issues associated with traditional Hamilton-Jacobi-Bellman formulations in PI.
    • The developed adaptive critic controller is effective for continuous-time systems with unknown dynamics, demonstrated by real-time robotic manipulator experiments.
    • This work provides a foundational contribution to understanding and controlling system stability within adaptive critic-based policy iteration frameworks.