EKG-AC:基于离线强化学习与专家知识指导的离线强化学习的工业过程优化新范式.
IEEE transactions on cybernetics
|July 17, 2025
概括
本研究介绍了一种新的线下强化学习 (RL) 算法,即专家知识指导行为者-关键 (EKG-AC),以安全优化工业流程. 该EKG-AC方法增强了使用专家知识的决策,提高了运营效率和利能力.
科学领域:
- 过程控制和优化过程.
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 操作优化对于工业产品的质量和利能力至关重要.
- 强化学习 (RL) 提供自主学习,但由于高成本和风险而面临现实世界的限制.
- 离线RL解决了交互风险,但在工业环境中与不平衡的数据和安全性作斗争.
研究的目的:
- 开发一种新的离线强化学习算法,用于工业流程优化.
- 解决线下RL应用中不平衡的操作条件和安全敏感性的挑战.
- 提高工业过程中的决策准确性和运营效率.
主要方法:
- 引入了一个新的线下演员-批评算法与专家知识指导 (EKG-AC).
- 采用基于扩散变压器的动作生成框架来缓解分布之外的问题.
- 整合了一个专家知识指导机制,用于安全和适应性行动的生成.
主要成果:
- 该EKG-AC算法在现实世界工业过程中展示了卓越的优化性能.
- 该方法产生了与专家决策密切结合的操作决策.
- 在两个不同的工业过程场景中验证了有效性.
结论:
- 拟议的EKG-AC算法为工业优化中的线下强化学习提供了实用和有价值的解决方案.
- 专家知识的整合提高了RL剂在敏感工业环境中的安全性和适应性.
- 扩散变压器框架有效地解决了复杂工业应用的线下RL的挑战.
更多相关视频
相关概念视频
Parameters Affecting Nonlinear Elimination: Zero-Order Input, First-Order Absorption and Two-Compartment Model
126
Drugs administered through various routes can lead to nonlinear elimination, resulting in complex pharmacokinetic behaviors crucial to understanding efficacious drug dosing.
When a drug is administered through a constant intravenous infusion and eliminated via nonlinear pharmacokinetics, it follows zero-order input. For example, oral drugs undergo first-order absorption upon administration and are eliminated through nonlinear pharmacokinetics.
In the case of subcutaneously administered drugs,...
When a drug is administered through a constant intravenous infusion and eliminated via nonlinear pharmacokinetics, it follows zero-order input. For example, oral drugs undergo first-order absorption upon administration and are eliminated through nonlinear pharmacokinetics.
In the case of subcutaneously administered drugs,...
126
Instrumentation Amplifier
712
An electrocardiography (ECG) machine is an essential piece of medical equipment used to monitor the electrical activity of the heart. It operates by detecting small electrical changes on the skin that result from the depolarization of the heart muscle during each heartbeat. However, these signals are in the microvolt range and can be easily overwhelmed by noise or interference.
To overcome this challenge, an ECG machine utilizes an instrumentation amplifier. This specialized amplifier is...
To overcome this challenge, an ECG machine utilizes an instrumentation amplifier. This specialized amplifier is...
712
Control Systems
1.4K
Control systems are everywhere in contemporary society, influencing diverse applications from aerospace to automated manufacturing. These systems can be found naturally within biological processes, such as blood sugar regulation and heart rate adjustment in response to stress, as well as in man-made systems like elevators and automated vehicles. A control system is essentially a network of subsystems and processes that collaboratively convert specific inputs into desired outputs.
At the heart...
At the heart...
1.4K
Open and closed-loop control systems
1.0K
Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
1.0K


