Jove
Visualize
Contact Us

Related Concept Videos

Feedback control systems01:26

Feedback control systems

816
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
816
Control Systems01:10

Control Systems

2.1K
Control systems are everywhere in contemporary society, influencing diverse applications from aerospace to automated manufacturing. These systems can be found naturally within biological processes, such as blood sugar regulation and heart rate adjustment in response to stress, as well as in man-made systems like elevators and automated vehicles. A control system is essentially a network of subsystems and processes that collaboratively convert specific inputs into desired outputs.
At the heart...
2.1K
Linear Approximation in Time Domain01:21

Linear Approximation in Time Domain

431
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
431
First Order Systems01:21

First Order Systems

529
First-order systems, such as RC circuits, are foundational in understanding dynamic systems due to their straightforward input-output relationship. Analyzing their responses to different input functions under zero initial conditions reveals significant insights into system behavior.
When a first-order system is subjected to a unit-step input, its response is characterized by its transfer function. By applying the Laplace transform of the unit-step input to the transfer function, expanding the...
529
Open and closed-loop control systems01:17

Open and closed-loop control systems

2.1K
Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
2.1K
Time-Domain Interpretation of PD Control01:07

Time-Domain Interpretation of PD Control

475
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
475

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Adaptive Learning Control of Uncertain Systems via Weight and Intrinsic Plasticity-Based Neural Networks.

IEEE transactions on neural networks and learning systems·2026
Same author

Prescribed-rate target tracking for time-delayed systems using output measurements.

Neural networks : the official journal of the International Neural Network Society·2026
Same author

Inverse Reinforcement Learning for Disturbed Networked Nonlinear Systems With Data Dropouts.

IEEE transactions on neural networks and learning systems·2025
Same author

Neuroadaptive Control With Enhanced Stability and Reliability.

IEEE transactions on neural networks and learning systems·2025
Same author

Inverse Reinforcement Learning for Discrete-Time Systems With Data Dropouts.

IEEE transactions on cybernetics·2025
Same author

Dynamic Analysis and Neural-Adaptive Prescribed-Time Control of the FO Memristive Magnetic-Field Electromechanical Transducer.

IEEE transactions on cybernetics·2024
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Apr 18, 2026

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
08:18

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

Published on: August 15, 2020

5.5K

Optimal Tracking Control of Unknown Discrete-Time Linear Systems Using Input-Output Measured Data.

Bahare Kiumarsi, Frank L Lewis, Mohammad-Bagher Naghibi-Sistani

    IEEE Transactions on Cybernetics
    |January 11, 2015
    PubMed
    Summary

    This study introduces an output-feedback controller for unknown discrete-time systems using reinforcement learning. The novel approach solves the linear quadratic tracking problem online without system knowledge, relying solely on measured data.

    More Related Videos

    Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques
    09:01

    Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques

    Published on: April 4, 2017

    9.2K
    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
    06:45

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

    Published on: October 28, 2022

    2.2K

    Related Experiment Videos

    Last Updated: Apr 18, 2026

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
    08:18

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

    Published on: August 15, 2020

    5.5K
    Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques
    09:01

    Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques

    Published on: April 4, 2017

    9.2K
    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
    06:45

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

    Published on: October 28, 2022

    2.2K

    Area of Science:

    • Control Systems Engineering
    • Machine Learning
    • System Identification

    Background:

    • The linear quadratic tracking (LQT) problem is crucial for control systems.
    • Solving LQT for unknown discrete-time systems with output feedback presents significant challenges.
    • Existing methods often require complete system model knowledge.

    Purpose of the Study:

    • To propose an output-feedback solution for the infinite-horizon LQT problem in unknown discrete-time systems.
    • To develop a method that does not require prior knowledge of system dynamics.
    • To utilize approximate dynamic programming and reinforcement learning for online controller synthesis.

    Main Methods:

    • Constructing an augmented system combining system and reference trajectory dynamics.
    • Developing a novel Bellman equation using only historical input, output, and reference trajectory data.
    • Applying policy iteration (PI) and value iteration (VI) algorithms from reinforcement learning.

    Main Results:

    • An online LQT solution is achieved without explicit system identification.
    • The proposed policy iteration and value iteration algorithms demonstrate convergence.
    • A simulation example validates the effectiveness of the developed control scheme.

    Conclusions:

    • The proposed method offers a viable approach to solving the LQT problem for unknown systems using output feedback.
    • Reinforcement learning, specifically approximate dynamic programming, enables online control without system knowledge.
    • The developed PI and VI algorithms provide a robust framework for optimal controller convergence.