基于学习的近乎最佳的跟踪控制,用于工业过程,具有缓慢和快速模式
1School of Information and Control Engineering, Liaoning Petrochemical University, Fushun, 113001, PR China.
ISA transactions
|July 14, 2023
概括
本研究引入了一种新的强化学习 (RL) 方法,用于在单一扰动系统中实现最佳的跟踪控制. 它解决了诸如未知的状态和不同的时间尺度等挑战,以更好地控制工业过程.
科学领域:
- 控制工程 控制工程 控制工程
- 人工智能的人工智能
- 工业过程优化 工业过程优化
背景情况:
- 单一扰动系统由于时间尺度不一致和无法测量的状态而带来控制挑战.
- 优化跟踪控制 (OTC) 对工业过程至关重要,但在未知的系统动态下难以实现.
- 现有的强化学习 (RL) 方法难以应对单一扰动系统的复杂性.
研究的目的:
- 开发一种新的强化学习 (RL) 方法,用于解决单一扰动系统中的最佳跟踪控制 (OTC) 问题.
- 为了应对这些系统固有的未知缓慢状态和不同的时间尺度所带来的挑战.
- 通过精确跟踪所需轨迹来提高工业过程的控制性能.
主要方法:
- 使用奇点扰动 (SP) 理论分解奇点扰动系统.
- 开发一种新的政策之外的脊强化学习 (RL) 算法.
- 在RL框架内替换未测量的慢状态的数学操作.
- 理论分析以确保子问题解决方案对整体OTC问题的近似等价性.
主要成果:
- 一种新的政策之外的RL方法有效地处理单一扰动系统.
- 提出的方法成功地克服了未知的状态和多时间尺度动态的挑战.
- 对于具有不可测量的状态的系统,证明了找到最佳跟踪控制器的能力.
- 通过应用到混合分离加厚工艺 (MSTP) 和数值示例进行验证.
结论:
- 开发的政策之外的峰RL方法为单一扰动系统中的OTC问题提供了有效的解决方案.
- 该方法成功地集成了单一扰动理论和强化学习,用于复杂的工业应用.
- 这项工作在控制具有挑战性的动态特征的工业过程方面取得了重大进展.
更多相关视频
09:01Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques
Published on: April 4, 2017
8.7K
10:51An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces
Published on: March 10, 2011
13.8K
相关概念视频
01:26Feedback control systems
349
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
349
01:17Open and closed-loop control systems
822
Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
822
01:10Control Systems
1.2K
Control systems are everywhere in contemporary society, influencing diverse applications from aerospace to automated manufacturing. These systems can be found naturally within biological processes, such as blood sugar regulation and heart rate adjustment in response to stress, as well as in man-made systems like elevators and automated vehicles. A control system is essentially a network of subsystems and processes that collaboratively convert specific inputs into desired outputs.
At the heart...
At the heart...
1.2K
01:22Controller Configurations
126
Controller configurations are crucial in a car's cruise control system because they manage speed over time to maintain a consistent pace regardless of road conditions, thereby meeting design goals. In traditional control systems, fixed-configuration design involves predetermined controller placement. System performance modifications are known as compensation.
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
126
01:07Time-Domain Interpretation of PD Control
143
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
Consider the example of control of motor torque. Initially, a positive...
143
01:21Linear Approximation in Time Domain
106
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
106