Related Experiment Video
Updated: Jan 16, 2026

Experimental Investigation of the Hierarchical Control in DC Microgrids Using a Real-time Simulator
Published on: February 14, 2025
Policy-Iteration-Based Asynchronous Control of Jump Systems With Hidden Mode Observation and H∞ Disturbance
Abstract:
This article is concerned with the asynchronous $H_{\infty }$ control design based on model-free policy iteration (PI) algorithm for a class of discrete-time hidden Markov jump system, where a hidden Markov model is developed to characterize the asynchronous phenomenon between the controller modes and the system modes. A pair of zero-sum asynchronous control and disturbance strategies are constructed to achieve a tradeoff between value function and control performance. The presented approach shows two pivotal aspects: 1) the asynchronous PI algorithm is not dependent on strict temporal alignment between the controller and the system's dynamics, enhancing flexibility of the control scheme and 2) it relies on the collected data to solve the algebraic Reccati equation iteratively, which avoids the need for system-internal and transfer probability information, and circumvents the interference of coupled terms. Subsequently, it is verified that the designed PI algorithm monotonically converges to an optimal solution and the system based on this optimal solution is stochastically stable in the mean-square sense. Finally, the effectiveness of this approach is validated by conducting a simulation experiment on a DC motor device system.
Related Concept Videos
BIBO stability of continuous and discrete -time systems
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
Feedback control systems
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Linear time-invariant Systems
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
Cyclic Processes And Isolated Systems
In the case of a non-isolated system, the change in the internal energy is zero only if the process is cyclic. A thermodynamic process is considered cyclic if the system undergoes a series of changes and returns to its initial state.
Consider a cyclic process that returns to its initial state, undergoing a four-step process. The heat transfer along each...
Control Systems
At the heart...
Second Order systems II

