Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Time-Domain Interpretation of PD Control01:07

Time-Domain Interpretation of PD Control

Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
Feedback control systems01:26

Feedback control systems

Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Effects of feedback01:24

Effects of feedback

Feedback in control systems plays a critical role in shaping various operational parameters, extending beyond simple error reduction to influence stability, bandwidth, gain, impedance, and sensitivity. Understanding these effects requires examining a basic feedback system characterized by defined input, output, error, and feedback signals.
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
Control System Problem01:21

Control System Problem

In an open-loop system, such as a basic thermostat, the poles of the transfer function influence the system's response but do not determine its stability. However, when feedback is introduced to form a closed-loop system, such as an advanced thermostat that adjusts heating based on room temperature, stability is governed by the new poles of the closed-loop transfer function.
When forming a closed-loop system, issues can arise if the poles cross into the unstable region, leading to potential...
Controller Configurations01:22

Controller Configurations

Controller configurations are crucial in a car's cruise control system because they manage speed over time to maintain a consistent pace regardless of road conditions, thereby meeting design goals. In traditional control systems, fixed-configuration design involves predetermined controller placement. System performance modifications are known as compensation.
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller aligns...
Stability01:28

Stability

The time response of a linear time-invariant (LTI) system can be divided into transient and steady-state responses. The transient response represents the system's initial reaction to a change in input and diminishes to zero over time. In contrast, the steady-state response is the behavior that persists after the transient effects have faded.
The stability of an LTI system is determined by the roots of its characteristic equation, known as poles. A system is stable if it produces a bounded...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Adaptive Learning Control of Uncertain Systems via Weight and Intrinsic Plasticity-Based Neural Networks.

IEEE transactions on neural networks and learning systems·2026
Same author

Prescribed-rate target tracking for time-delayed systems using output measurements.

Neural networks : the official journal of the International Neural Network Society·2026
Same author

Inverse Reinforcement Learning for Disturbed Networked Nonlinear Systems With Data Dropouts.

IEEE transactions on neural networks and learning systems·2025
Same author

Neuroadaptive Control With Enhanced Stability and Reliability.

IEEE transactions on neural networks and learning systems·2025
Same author

Inverse Reinforcement Learning for Discrete-Time Systems With Data Dropouts.

IEEE transactions on cybernetics·2025
Same author

Dynamic Analysis and Neural-Adaptive Prescribed-Time Control of the FO Memristive Magnetic-Field Electromechanical Transducer.

IEEE transactions on cybernetics·2024

Related Experiment Video

Updated: Jul 3, 2026

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

Issues on stability of ADP feedback controllers for dynamical systems.

S N Balakrishnan1, Jie Ding, Frank L Lewis

  • 1Department of Mechanical and Aerospace Engineering, Missouri University of Science and Technology, Rolla, MO 65401, USA. bala@mst.edu

IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society
|July 18, 2008
PubMed
Summary

This study reviews neural-network (NN)-based feedback controllers using adaptive/approximate dynamic programming (ADP). It highlights advancements in NN structures and their closed-loop stability, noting a growing body of research in this area.

More Related Videos

An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces
10:51

An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces

Published on: March 10, 2011

Related Experiment Videos

Last Updated: Jul 3, 2026

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces
10:51

An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces

Published on: March 10, 2011

Area of Science:

  • Control Systems Engineering
  • Artificial Intelligence
  • Machine Learning

Background:

  • Neural-network (NN)-based feedback controllers are increasingly important in complex control systems.
  • Adaptive/Approximate Dynamic Programming (ADP) provides a theoretical framework for developing intelligent controllers.
  • Ensuring closed-loop stability is a critical challenge in NN-based control.

Purpose of the Study:

  • To trace the development of NN-based feedback controllers derived from ADP principles.
  • To discuss the closed-loop stability of these NN-based controllers.
  • To review different NN structures and ADP applications in control literature.

Main Methods:

  • Literature review of NN-based feedback controllers and ADP.
  • Analysis of various NN structures, including adaptive critics and action-critic networks.
  • Examination of model-free and model-based neurocontroller developments concerning stability.

Main Results:

  • Different NN structures for ADP-based controllers have been developed.
  • The paper distinguishes between two main classes of ADP applications.
  • Contributions to stability issues in both model-free and model-based approaches are reviewed.

Conclusions:

  • Research in ADP-based feedback controllers with assured stability is expanding.
  • Diverse forms of NN-based controllers are emerging in the literature.
  • The integration of ADP principles with NNs offers promising avenues for robust control systems.