Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Feedback control systems01:26

Feedback control systems

471
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
471
Linear Approximation in Time Domain01:21

Linear Approximation in Time Domain

135
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
135
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

114
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
114
Time-Domain Interpretation of PD Control01:07

Time-Domain Interpretation of PD Control

193
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
193
Linear Approximation in Frequency Domain01:26

Linear Approximation in Frequency Domain

149
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
149
PD Controller: Design01:26

PD Controller: Design

375
In automotive engineering, car suspension systems often employ Proportional Derivative (PD) controllers to enhance performance. PD controllers are utilized to adjust the damping force in response to road conditions. A controller, acting as an amplifier with a constant gain, demonstrates proportional control, with output directly mirroring input.
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
375

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Optimal design of lock-down and reopening policies for early-stage epidemics through SIR-D models.

Annual reviews in control·2021
Same author

A time-varying SIRD model for the COVID-19 contagion in Italy.

Annual reviews in control·2020
Same author

A new metric for understanding hidden political influences from voting records.

PloS one·2020
Same author

Output Feedback Q-Learning for Linear-Quadratic Discrete-Time Finite-Horizon Control Problems.

IEEE transactions on neural networks and learning systems·2020
Same author

A Universal Approximation Result for Difference of Log-Sum-Exp Neural Networks.

IEEE transactions on neural networks and learning systems·2020
Same author

Log-Sum-Exp Neural Networks and Posynomial Models for Convex and Log-Log-Convex Data.

IEEE transactions on neural networks and learning systems·2019

Related Experiment Video

Updated: Oct 5, 2025

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
08:18

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

Published on: August 15, 2020

5.1K

Data-Driven Policy Iteration for Nonlinear Optimal Control Problems.

Corrado Possieri, Mario Sassano

    IEEE Transactions on Neural Networks and Learning Systems
    |January 31, 2022
    PubMed
    Summary

    This study introduces a novel data-driven method for designing optimal control laws for nonlinear systems using only real-time measurements. The approach leverages neural networks for policy iteration, enabling effective control without prior system knowledge.

    More Related Videos

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
    06:45

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

    Published on: October 28, 2022

    1.8K
    Interactive and Visualized Online Experimentation System for Engineering Education and Research
    08:35

    Interactive and Visualized Online Experimentation System for Engineering Education and Research

    Published on: November 24, 2021

    2.6K

    Related Experiment Videos

    Last Updated: Oct 5, 2025

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
    08:18

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

    Published on: August 15, 2020

    5.1K
    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
    06:45

    Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator

    Published on: October 28, 2022

    1.8K
    Interactive and Visualized Online Experimentation System for Engineering Education and Research
    08:35

    Interactive and Visualized Online Experimentation System for Engineering Education and Research

    Published on: November 24, 2021

    2.6K

    Area of Science:

    • Control Theory
    • Machine Learning
    • Nonlinear Systems

    Background:

    • Designing optimal control laws for nonlinear systems often requires complete knowledge of the system dynamics and cost function.
    • Existing methods can be limited by the need for precise system models.

    Purpose of the Study:

    • To develop a data-driven optimal control design method for nonlinear systems that does not require prior knowledge of the plant or cost function.
    • To implement a policy iteration strategy using neural networks for continuous-time control.

    Main Methods:

    • A novel data-driven approach utilizing real-time state measurements and reward signals.
    • Integration of concepts from optimal and adaptive control theories.
    • Application of neural networks within a policy iteration framework for continuous-time policy evaluation and improvement.

    Main Results:

    • Successful design of optimal control laws for nonlinear systems without explicit plant or cost function knowledge.
    • Demonstration of convergence rate and robustness properties of the proposed method.
    • Validation through two benchmark numerical simulations.

    Conclusions:

    • The proposed data-driven method offers a viable alternative for optimal control design in scenarios with limited system information.
    • The continuous-time, neural network-based policy iteration provides an effective and robust control strategy.
    • The method's performance is confirmed by simulation results, highlighting its practical applicability.