Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

540
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
540
Linear time-invariant Systems01:23

Linear time-invariant Systems

1.1K
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
1.1K
Feedback control systems01:26

Feedback control systems

794
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
794
Classification of Systems-II01:31

Classification of Systems-II

638
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
638
Parameters Affecting Nonlinear Elimination: Zero-Order Input, First-Order Absorption and Two-Compartment Model01:13

Parameters Affecting Nonlinear Elimination: Zero-Order Input, First-Order Absorption and Two-Compartment Model

425
Drugs administered through various routes can lead to nonlinear elimination, resulting in complex pharmacokinetic behaviors crucial to understanding efficacious drug dosing.
When a drug is administered through a constant intravenous infusion and eliminated via nonlinear pharmacokinetics, it follows zero-order input. For example, oral drugs undergo first-order absorption upon administration and are eliminated through nonlinear pharmacokinetics.
In the case of subcutaneously administered drugs,...
425
BIBO stability of continuous and discrete -time systems01:24

BIBO stability of continuous and discrete -time systems

1.1K
System stability is a fundamental concept in signal processing, often assessed using convolution. For a system to be considered bounded-input bounded-output (BIBO) stable, any bounded input signal must produce a bounded output signal. A bounded input signal is one where the modulus does not exceed a certain constant at any point in time.
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
1.1K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Enhanced Chondrogenic Differentiation of Electrically Primed Human Mesenchymal Stem Cells for the Regeneration of Osteochondral Defects.

Biomaterials research·2024
Same author

Structural analysis of ExaC, an NAD<sup>+</sup>-dependent aldehyde dehydrogenase, from Pseudomonas aeruginosa.

Biochemical and biophysical research communications·2024
Same author

Structural insights into BirA from Haemophilus influenzae, a bifunctional protein as a biotin protein ligase and a transcriptional repressor.

Biochemical and biophysical research communications·2024
Same author

The Long-term Outcomes and Risk Factors of Complications After Fontan Surgery: From the Korean Fontan Registry (KFR).

Korean circulation journal·2024
Same author

US Markers and Necroinflammation, Steatosis, and Fibrosis in Metabolic Dysfunction-associated Steatotic Liver Disease: The iLEAD Study.

Radiology·2024
Same author

Generation of a human SLC12A3 knock-in human induced pluripotent stem cell line (CMCi014-A-82) using CRISPR-Cas9 system.

Stem cell research·2024

Related Experiment Video

Updated: Apr 25, 2026

Quantifying Learning in Young Infants: Tracking Leg Actions During a Discovery-learning Task
11:18

Quantifying Learning in Young Infants: Tracking Leg Actions During a Discovery-learning Task

Published on: June 1, 2015

10.3K

Integral reinforcement learning for continuous-time input-affine nonlinear systems with simultaneous invariant

Jae Young Lee, Jin Bae Park, Yoon Ho Choi

    IEEE Transactions on Neural Networks and Learning Systems
    |August 28, 2014
    PubMed
    Summary
    This summary is machine-generated.

    This study introduces integral reinforcement learning (I-RL) algorithms for continuous-time nonlinear optimal control problems. These novel methods ensure stable exploration and convergence for model-free learning, enhancing control system safety and performance.

    More Related Videos

    Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
    11:54

    Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

    Published on: May 8, 2021

    4.2K

    Related Experiment Videos

    Last Updated: Apr 25, 2026

    Quantifying Learning in Young Infants: Tracking Leg Actions During a Discovery-learning Task
    11:18

    Quantifying Learning in Young Infants: Tracking Leg Actions During a Discovery-learning Task

    Published on: June 1, 2015

    10.3K
    Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
    11:54

    Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

    Published on: May 8, 2021

    4.2K

    Area of Science:

    • Control Theory
    • Machine Learning
    • Nonlinear Systems

    Background:

    • Continuous-time nonlinear optimal control problems present significant challenges.
    • Existing reinforcement learning (RL) methods often struggle with stability and exploration in these complex systems.

    Purpose of the Study:

    • To develop novel integral reinforcement learning (I-RL) algorithms for continuous-time (CT) nonlinear optimal control.
    • To ensure stable exploration and convergence properties for model-free learning in input-affine systems.

    Main Methods:

    • Extension of exploration, integral temporal difference, and invariant admissibility concepts to CT nonlinear systems.
    • Development of integral policy iteration (I-PI) and invariantly admissible PI (IA-PI) methods.
    • Proposal of three online I-RL algorithms: explorized I-PI and integral Q-learning I, II.

    Main Results:

    • Demonstration of input-to-state stability (ISS) and invariant admissibility for closed-loop systems.
    • Validation of proposed algorithms' convergence properties under excitation conditions.
    • Verification of model-free capabilities and stable state-space exploration during online learning.

    Conclusions:

    • The proposed I-RL algorithms effectively solve CT nonlinear optimal control problems.
    • Neural-network-based implementations are presented, demonstrating practical applicability.
    • Design principles for safe exploration in reinforcement learning are established.