Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

PD Controller: Design01:26

PD Controller: Design

689
In automotive engineering, car suspension systems often employ Proportional Derivative (PD) controllers to enhance performance. PD controllers are utilized to adjust the damping force in response to road conditions. A controller, acting as an amplifier with a constant gain, demonstrates proportional control, with output directly mirroring input.
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
689
Time-Domain Interpretation of PD Control01:07

Time-Domain Interpretation of PD Control

428
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
428
Feedback control systems01:26

Feedback control systems

761
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
761
PI Controller: Design01:24

PI Controller: Design

1.4K
Proportional Integral (PI) controllers are a fundamental component in modern control systems, widely used to enhance performance and mitigate steady-state errors. They are particularly effective in applications such as automatic brightness adjustment on smartphones, where they excel at mitigating steady-state errors for step-function inputs. Unlike PD controllers, which require time-varying errors to function optimally, PI controllers leverage their integral component to address residual...
1.4K
PID Controller01:19

PID Controller

842
Proportional-Integral-Derivative (PID) controllers are widely used in various control systems to enhance stability and performance. In a thermostat, it adjusts heating or cooling based on the temperature difference between the actual and desired levels. They are often used in automotive speed systems, effectively managing sudden speed changes while maintaining a constant speed under varying conditions. On the other hand, PI controllers, commonly employed in voltage regulation, enhance stability...
842
Open and closed-loop control systems01:17

Open and closed-loop control systems

1.9K
Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
1.9K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Cross-sector deep learning scales life cycle assessment using unified textual descriptions.

Environmental science and ecotechnology·2026
Same author

[Retracted] Acaricidal activity of extracts from <i>Ligularia virgaurea</i> against the <i>Sarcoptes scabiei</i> mite <i>in vitro</i>.

Experimental and therapeutic medicine·2026
Same author

Recent Advances on Off-Policy Reinforcement Learning for Optimization Control.

IEEE transactions on cybernetics·2026
Same author

Optimal cooperative output regulation with norm-based performance specifications.

ISA transactions·2026
Same author

DACESR: Degradation-Aware Conditional Embedding for Real-World Image Super-Resolution.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same author

Time-Varying HJBE-Based Adaptive Safe Critic Control Design for Stochastic Asymmetric Constrained Multiagent Systems.

IEEE transactions on cybernetics·2026
Same journal

Robust Semiglobal and Global Stabilization for Nonlinear Normal Form Systems by Time-Varying Feedback.

IEEE transactions on cybernetics·2026
Same journal

Adaptive Global Asymptotic Output Stabilization of Uncertain Nonlinear Systems Under Dynamic State/Input Quantization.

IEEE transactions on cybernetics·2026
Same journal

Accelerated Distributed Gradient Tracking for Constrained Aggregative Optimization Over Time-Varying Digraphs.

IEEE transactions on cybernetics·2026
Same journal

Small-Gain-Based Plug-and-Play Distributed Control Framework for DC Microgrids With Decentralized Reconfiguration.

IEEE transactions on cybernetics·2026
Same journal

Prescribed-Time Impulsive Control of High-Order Integrator Systems.

IEEE transactions on cybernetics·2026
Same journal

Relaxed Stability Conditions for Model Predictive Control of Hybrid Dynamical Systems Using Hybrid Recurrent Neural Networks.

IEEE transactions on cybernetics·2026
See all related articles

Related Experiment Video

Updated: Mar 11, 2026

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

5.2K

Policy Gradient Adaptive Dynamic Programming for Data-Based Optimal Control.

Biao Luo, Derong Liu, Huai-Ning Wu

    IEEE Transactions on Cybernetics
    |November 29, 2016
    PubMed
    Summary
    This summary is machine-generated.

    This study introduces a data-driven Policy Gradient Adaptive Dynamic Programming (PGADP) algorithm for optimal control of nonlinear systems. The method enhances control policies using gradient descent, proving convergence for improved system performance.

    Related Experiment Videos

    Last Updated: Mar 11, 2026

    Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
    11:54

    Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

    Published on: May 8, 2021

    5.2K

    Area of Science:

    • Control Theory
    • Machine Learning
    • Nonlinear Systems

    Background:

    • Optimal control for discrete-time nonlinear systems is challenging without a precise system model.
    • Data-driven approaches are increasingly vital for complex control problems.

    Purpose of the Study:

    • To develop a model-free adaptive optimal control method using data.
    • To design a Policy Gradient Adaptive Dynamic Programming (PGADP) algorithm for this purpose.

    Main Methods:

    • Utilizing offline and online data, not a mathematical system model.
    • Employing a gradient descent scheme to iteratively improve the control policy.
    • Implementing an actor-critic structure with the method of weighted residuals.

    Main Results:

    • Demonstrated convergence of the PGADP algorithm and its Q-function sequence to the optimal Q-function.
    • Analyzed convergence properties of the adaptive control method, showing approximate Q-function convergence.
    • Validated the effectiveness of the PGADP-based adaptive control through computer simulations.

    Conclusions:

    • The PGADP algorithm provides an effective model-free approach for adaptive optimal control.
    • The developed adaptive control method shows promising convergence and performance.
    • This data-driven technique offers a viable alternative for controlling complex nonlinear systems.