强化学习高炉铁制操作与安全和部分观察考虑
IEEE transactions on neural networks and learning systems
|January 17, 2024
概括
本研究介绍了一种安全的线下强化学习 (RL) 方法,用于高炉 (BF) 操作. 该方法使用专家数据来优化决策,确保安全并最大限度地提高复杂工业环境中的回报.
科学领域:
- 工业过程控制 工业过程控制
- 人工智能的人工智能
- 材料科学 材料科学 材料科学
背景情况:
- 优化高炉 (BF) 操作对于钢铁制造业的利能力至关重要.
- 挑战包括监管滞后,矿石来源的不确定性和持续的决策需求.
- 传统的在线强化学习 (RL) 被安全限制所阻碍,防止在线试错探索.
研究的目的:
- 开发一种新的线下强化学习 (RL) 方法,用于BF运营.
- 为了确保安全,最大限度地提高运行回报率,并处理部分观察到的状态.
- 解决复杂工业环境中传感器数据的局限性.
主要方法:
- 使用了一个非政策的行为者-关键框架,并使用了专家操作轨迹.
- 员工为参与者提供联合培训,使用监督和评估信号进行低风险,高回报的决策.
- 从传感器的局限性来解决部分观察到的马尔科夫决策过程 (POMDPs).
主要成果:
- 拟议的离线RL算法在BF炼过程中表现出更好的性能.
- 在运营安全和最大化回报方面观察到关键的改进.
- 有效地处理传感器有限的工业环境中固有的部分观察状态.
结论:
- 新型离线RL方法为BF运营中的决策提供了一种安全有效的方法.
- 经常性网络提高了管理POMDP的能力,这对复杂的工业系统至关重要.
- 这种方法为提高钢铁制造业的利能力和安全性提供了可行的解决方案.
相关概念视频
Steel Manufacturing
475
Steel manufacturing is a multi-stage process that begins by smelting iron ore into cast iron in a blast furnace. This initial stage involves layering iron ore with coke, a type of fuel, and crushed limestone within the furnace. The coke is ignited with a high volume of air, leading to the creation of carbon monoxide, which acts to reduce the iron ore to pure iron.
During this smelting process, limestone plays a crucial role by forming slag. Slag captures impurities within the molten iron, such...
During this smelting process, limestone plays a crucial role by forming slag. Slag captures impurities within the molten iron, such...
475
Observational Learning
179
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
179
Steps in the Modeling Process
209
Albert Bandura's theory of observational learning identifies four critical processes: attention, retention, motor reproduction, and reinforcement or motivation.
Attention is the first necessary component for observational learning. It involves focusing on what the model is doing and saying. For example, if you decide to take a drawing class to enhance your skills, you need to pay close attention to the instructor's words and hand movements. The characteristics of the model significantly...
Attention is the first necessary component for observational learning. It involves focusing on what the model is doing and saying. For example, if you decide to take a drawing class to enhance your skills, you need to pay close attention to the instructor's words and hand movements. The characteristics of the model significantly...
209


