Related Experiment Video
Updated: Sep 4, 2025

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
Published on: August 15, 2020
Periodic event-triggered adaptive tracking control design for nonlinear discrete-time systems via reinforcement
Fanghua Tang1, Ben Niu2, Guangdeng Zong3
1College of Control Science and Engineering, Bohai University, Jinzhou 121013, Liaoning, China.
This study introduces a periodic event-triggered control (ETC) for nonlinear systems using reinforcement learning. The method conserves resources by updating controllers only when necessary, ensuring system stability.
Area of Science:
- Control Systems Engineering
- Artificial Intelligence
- Nonlinear Dynamics
Background:
- Traditional control systems often require continuous data transmission, leading to inefficient resource utilization.
- Event-triggered control (ETC) offers a more efficient alternative by transmitting data only when specific conditions are met.
- Reinforcement learning (RL) provides a powerful framework for developing adaptive control strategies.
Purpose of the Study:
- To develop a novel periodic event-triggered control (ETC) scheme for nonlinear discrete-time systems.
- To integrate an actor-critic architecture within reinforcement learning (RL) for adaptive control.
- To enhance resource efficiency in control systems through intelligent data transmission.
Main Methods:
- A periodic event-triggered mechanism (ETM) was designed to regulate data transmission to controllers.
- An actor-critic neural network architecture, utilizing radial basis function neural networks (RBFNNs), was employed.
- Lyapunov stability analysis was used to rigorously prove system stability and boundedness of error signals.
Main Results:
- The proposed periodic ETM guarantees a minimum inter-event interval, optimizing communication resource usage.
- The RL-based actor-critic approach successfully approximates the optimal control policy and performance index.
- Stability analysis confirmed that all closed-loop system error signals are uniformly ultimately bounded (UUB).
Conclusions:
- The developed event-triggered control scheme effectively stabilizes nonlinear discrete-time systems.
- The integration of periodic ETM with RL offers significant advantages in communication resource economy.
- Simulation examples validate the practical effectiveness and performance of the proposed control strategy.
Related Concept Videos
Feedback control systems
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
PD Controller: Design
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
Linear Approximation in Time Domain
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
Time-Domain Interpretation of PD Control
Consider the example of control of motor torque. Initially, a positive...
Controller Configurations
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
Transient and Steady-state Response
These test signals are integral in designing control systems to exhibit two key performance aspects: transient response and steady-state...

