Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Feedback control systems01:26

Feedback control systems

Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Indeterminate Forms and L’Hôpital’s Rule01:27

Indeterminate Forms and L’Hôpital’s Rule

Indeterminate forms occur when evaluating limits leads to expressions that cannot be directly interpreted, such as zero divided by zero or infinity divided by infinity. These results do not describe the true behavior of a function near a given point and instead signal that additional analysis is required. L’Hôpital’s Rule provides a reliable method for resolving such ambiguities by replacing the original functions with their derivatives.Core Idea of L’Hôpital’s RuleL’Hôpital’s Rule applies when...
Controller Configurations01:22

Controller Configurations

Controller configurations are crucial in a car's cruise control system because they manage speed over time to maintain a consistent pace regardless of road conditions, thereby meeting design goals. In traditional control systems, fixed-configuration design involves predetermined controller placement. System performance modifications are known as compensation.
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller aligns...
Indeterminate Products01:29

Indeterminate Products

Indeterminate forms also arise in the evaluation of limits involving products, particularly when one factor approaches zero while the other tends to positive or negative infinity. This situation, commonly described as a zero-times-infinity form, does not have an immediately interpretable outcome. Depending on how the factors behave relative to one another, the limit of such a product may be zero, infinite, or a finite nonzero value.Product Limits and Algebraic RewritingTo analyze limits of this...
Time and frequency -Domain Interpretation of PI Control01:27

Time and frequency -Domain Interpretation of PI Control

Proportional-Integral (PI) controllers are essential in many control systems to improve stability and performance. They are commonly used in everyday devices like thermostats to enhance system damping and reduce steady-state error. When the zero in the controller's transfer function is optimally placed, the system benefits significantly in terms of stability and accuracy.
Acting as a low-pass filter, the PI controller slows the system's response and extends settling times. This requires careful...
Limits with Oscillating Discontinuities01:19

Limits with Oscillating Discontinuities

An oscillating discontinuity is a type of discontinuity in which a function’s values fluctuate infinitely often as the input approaches a particular point. Unlike jump discontinuities, where the function suddenly shifts between two values, or infinite discontinuities, where the function diverges without bound, an oscillating discontinuity arises from rapid back-and-forth variation. Because the function never stabilizes toward a single value, no finite limit exists at that point.One of the most...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Adaptive Learning Control of Uncertain Systems via Weight and Intrinsic Plasticity-Based Neural Networks.

IEEE transactions on neural networks and learning systems·2026
Same author

Prescribed-rate target tracking for time-delayed systems using output measurements.

Neural networks : the official journal of the International Neural Network Society·2026
Same author

Inverse Reinforcement Learning for Disturbed Networked Nonlinear Systems With Data Dropouts.

IEEE transactions on neural networks and learning systems·2025
Same author

Neuroadaptive Control With Enhanced Stability and Reliability.

IEEE transactions on neural networks and learning systems·2025
Same author

Inverse Reinforcement Learning for Discrete-Time Systems With Data Dropouts.

IEEE transactions on cybernetics·2025
Same author

Dynamic Analysis and Neural-Adaptive Prescribed-Time Control of the FO Memristive Magnetic-Field Electromechanical Transducer.

IEEE transactions on cybernetics·2024

Related Experiment Video

Updated: Jul 17, 2026

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
08:18

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

Published on: August 15, 2020

Adaptive critic designs for discrete-time zero-sum games with application to H(infinity) control.

Asma Al-Tamimi, Murad Abu-Khalaf, Frank L Lewis

    IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society
    |February 7, 2007
    PubMed
    Summary

    This study introduces adaptive critic designs for continuous state and action zero-sum games, yielding a reinforcement learning algorithm that converges to the Nash equilibrium. This method offers a novel approach to solving the discrete-time H(infinity) optimal control problem.

    Related Experiment Videos

    Last Updated: Jul 17, 2026

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
    08:18

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

    Published on: August 15, 2020

    Area of Science:

    • Control Theory
    • Artificial Intelligence
    • Game Theory

    Background:

    • Adaptive critic designs are explored for discrete-time zero-sum games with continuous state and action spaces.
    • This research addresses the challenge of solving complex game-theoretic problems using dynamic programming principles.

    Discussion:

    • The derived forward-in-time reinforcement learning algorithm converges to the Nash equilibrium.
    • This work provides a method to solve the Riccati equation for discrete-time H(infinity) optimal control problems.

    Key Insights:

    • Two schemes, heuristic dynamic programming and dual-heuristic dynamic programming, are presented.
    • These schemes effectively solve for the value function and costate of the game.
    • An H(infinity) autopilot for an F-16 aircraft demonstrates the practical application of the developed methods.

    Outlook:

    • The findings offer a new perspective on solving optimal control problems.
    • Future work could explore extensions to different game types or real-world control systems.