Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Feedback control systems01:26

Feedback control systems

821
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
821
Linear time-invariant Systems01:23

Linear time-invariant Systems

1.1K
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
1.1K
Open and closed-loop control systems01:17

Open and closed-loop control systems

2.1K
Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
2.1K
PI Controller: Design01:24

PI Controller: Design

1.6K
Proportional Integral (PI) controllers are a fundamental component in modern control systems, widely used to enhance performance and mitigate steady-state errors. They are particularly effective in applications such as automatic brightness adjustment on smartphones, where they excel at mitigating steady-state errors for step-function inputs. Unlike PD controllers, which require time-varying errors to function optimally, PI controllers leverage their integral component to address residual...
1.6K
Controller Configurations01:22

Controller Configurations

461
Controller configurations are crucial in a car's cruise control system because they manage speed over time to maintain a consistent pace regardless of road conditions, thereby meeting design goals. In traditional control systems, fixed-configuration design involves predetermined controller placement. System performance modifications are known as compensation.
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
461
BIBO stability of continuous and discrete -time systems01:24

BIBO stability of continuous and discrete -time systems

1.1K
System stability is a fundamental concept in signal processing, often assessed using convolution. For a system to be considered bounded-input bounded-output (BIBO) stable, any bounded input signal must produce a bounded output signal. A bounded input signal is one where the modulus does not exceed a certain constant at any point in time.
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
1.1K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Variance-constrained multi-view ensemble broad network for imbalanced data.

Neural networks : the official journal of the International Neural Network Society·2026
Same author

Learning to Super-Resolve Face Images via Dual-Domain Multi-scale Feature Interaction.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same author

Effectiveness of heterologous mRNA vaccine boosters during an Omicron wave of COVID-19: a cross-sectional study in Macao (China).

Journal of thoracic disease·2026
Same author

Fast BCIs: Leveraging Dual-Scale Time Windows with Test-Time Adaptation to Enhance Accuracy.

IEEE transactions on bio-medical engineering·2026
Same author

Riemannian Acceleration for Sparse PCA With Separable Structure and Second-Order Information Exploration.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same author

Hierarchical memory-based deep reinforcement learning in simulated survival environments.

Neural networks : the official journal of the International Neural Network Society·2026

Related Experiment Video

Updated: Apr 20, 2026

Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
06:45

Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

Published on: October 28, 2022

2.3K

Reinforcement learning design-based adaptive tracking control with less learning parameters for nonlinear

Yan-Jun Liu, Li Tang, Shaocheng Tong

    IEEE Transactions on Neural Networks and Learning Systems
    |December 2, 2014
    PubMed
    Summary

    This study introduces an online reinforcement learning algorithm using neural networks (NNs) for complex MIMO systems. The novel approach simplifies parameter tuning and improves control performance for unknown nonlinear systems.

    More Related Videos

    Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques
    09:01

    Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques

    Published on: April 4, 2017

    9.2K
    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
    08:18

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

    Published on: August 15, 2020

    5.5K

    Related Experiment Videos

    Last Updated: Apr 20, 2026

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
    06:45

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

    Published on: October 28, 2022

    2.3K
    Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques
    09:01

    Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques

    Published on: April 4, 2017

    9.2K
    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
    08:18

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

    Published on: August 15, 2020

    5.5K

    Area of Science:

    • Control Systems Engineering
    • Artificial Intelligence
    • Nonlinear System Dynamics

    Background:

    • Challenges in controlling nonlinear Multiple-Input Multiple-Output (MIMO) discrete-time systems with unknown dynamics and disturbances.
    • Limitations of existing adaptive control methods, particularly concerning the number of adaptation laws and parameter tuning complexity.

    Purpose of the Study:

    • To propose a novel online reinforcement learning algorithm for affine MIMO nonlinear discrete-time systems.
    • To develop a control strategy that reduces the number of adjustable parameters and simplifies tuning rules.
    • To ensure uniform boundedness of tracking errors, adaptation laws, and control inputs.

    Main Methods:

    • Utilizing a neural network (NN) approximator with two networks: an action network for control signal generation and a critic network for cost function approximation.
    • Implementing an online reinforcement learning framework to generate optimal control signals and adaptation laws.
    • Employing Lyapunov stability analysis to prove system performance and boundedness.

    Main Results:

    • A reduced number of adaptation laws (only two parameters to adjust) compared to previous methods.
    • Adaptation laws and tuning rules independent of the number of MIMO subsystems.
    • Demonstrated uniform boundedness of tracking errors, adaptation laws, and control inputs via Lyapunov analysis.
    • Validation of the proposed algorithm's effectiveness through simulation examples.

    Conclusions:

    • The proposed online reinforcement learning algorithm effectively controls affine MIMO nonlinear discrete-time systems with unknown dynamics.
    • The method offers significant advantages in parameter reduction and simplified tuning, enhancing practical applicability.
    • The algorithm guarantees system stability and bounded performance metrics, validated by theoretical analysis and simulations.