基于策略代的跳跃系统异步控制与隐藏模式观察和H∞干扰减弱
IEEE transactions on cybernetics
|September 29, 2025
概括
本研究介绍了一种无模型的政策代 (PI) 算法,用于异步控制隐藏的马尔科夫跳跃系统. 这种方法提高了灵活性,并避免了复杂的系统信息,以实现可靠的控制设计.
科学领域:
- 控制系统工程 控制系统工程
- 随机系统 随机系统 随机系统
- 机器学习用于控制控制.
背景情况:
- 隐藏的马尔科夫跳跃系统由于异步控制器和系统模式带来了挑战.
- 现有的控制设计往往需要精确的时间对齐和详细的系统模型.
研究的目的:
- 为离散时间隐藏的马尔科夫跳跃系统设计一个异步的H-无限控制策略.
- 开发一种无模型的政策代算法,以适应异步现象.
主要方法:
- 隐藏的马尔科夫模型被用来表示异步行为.
- 制定了一个零和控制和干扰策略.
- 一个无模型的政策代算法被用来解决代数的里卡蒂方程,使用收集的数据.
主要成果:
- 异步政策代算法通过不需要严格的时间对齐来证明了灵活性.
- 循环数据驱动的方法规避了对系统内部和传输概率信息的需求.
- 验证了政策代算法的单调融合到最佳解决方案.
- 由此产生的系统在平均平方意义上被证明是随机稳定的.
结论:
- 建议的无模型异步控制方法对隐藏的马尔科夫跳跃系统有效.
- 该方法通过依赖数据而不是明确的系统模型来提高灵活性和稳定性.
- 对直流电机系统的模拟结果验证了控制策略的实际适用性.
相关概念视频
BIBO stability of continuous and discrete -time systems
887
System stability is a fundamental concept in signal processing, often assessed using convolution. For a system to be considered bounded-input bounded-output (BIBO) stable, any bounded input signal must produce a bounded output signal. A bounded input signal is one where the modulus does not exceed a certain constant at any point in time.
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
887
Feedback control systems
687
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
687
Linear time-invariant Systems
872
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
872
Cyclic Processes And Isolated Systems
3.4K
A thermodynamic system with zero heat exchange and work is an isolated system. For these systems, the internal energy remains constant.
In the case of a non-isolated system, the change in the internal energy is zero only if the process is cyclic. A thermodynamic process is considered cyclic if the system undergoes a series of changes and returns to its initial state.
Consider a cyclic process that returns to its initial state, undergoing a four-step process. The heat transfer along each...
In the case of a non-isolated system, the change in the internal energy is zero only if the process is cyclic. A thermodynamic process is considered cyclic if the system undergoes a series of changes and returns to its initial state.
Consider a cyclic process that returns to its initial state, undergoing a four-step process. The heat transfer along each...
3.4K
Control Systems
1.8K
Control systems are everywhere in contemporary society, influencing diverse applications from aerospace to automated manufacturing. These systems can be found naturally within biological processes, such as blood sugar regulation and heart rate adjustment in response to stress, as well as in man-made systems like elevators and automated vehicles. A control system is essentially a network of subsystems and processes that collaboratively convert specific inputs into desired outputs.
At the heart...
At the heart...
1.8K
Second Order systems II
389
In an underdamped second-order system, where the damping ratio ζ is between 0 and 1, a unit-step input results in a transfer function that, when transformed using the inverse Laplace method, reveals the output response. The output exhibits a damped sinusoidal oscillation, and the difference between the input and output is termed the error signal. This error signal also demonstrates damped oscillatory behavior. Eventually, as the system reaches a steady state, the error diminishes to zero.
389


