强化学习算法的系统性绩效评估 应用到废水处理控制优化优化中的强化学习算法
Henry C Croll1, Kaoru Ikuma1, Say Kee Ong1
1Department of Civil, Construction, and Environmental Engineering, Iowa State University, Ames, Iowa 50011, United States.
Environmental science & technology
|July 5, 2023
概括
强化学习优化了废水处理. 双延迟深确定性政策梯度 (TD3) 算法在满足废水标准的同时,在活性污泥系统中显著减少了14.3%的能源消耗.
科学领域:
- 环境工程 环境工程
- 水处理技术水处理技术
- 环境科学中的人工智能
背景情况:
- 活性污泥废水处理涉及复杂的,非线性过程,其操作具有挑战性和能源密集性.
- 优化这些系统的高处理水平,包括营养物质的去除,是一个重要的研究重点.
- 机器学习,特别是强化学习,显示出改善控制策略的前景.
研究的目的:
- 评估四个强化学习算法的有效性,以优化活性污泥废水处理.
- 为了最大限度地减少能源消耗 (通风和),同时确保废水合规.
- 将强化学习控制与现有的基于领域的策略进行比较.
主要方法:
- 在过程建模软件和Python强化学习环境之间开发了一个新的界面.
- 测试了四种强化学习算法:深度Q学习,近接政策优化,同步优势行为体批评和双延迟深度决定性政策梯度 (TD3).
- 性能使用基准模拟模型编号进行评估. 1 (BSM1) 的部分.
主要成果:
- TD3始终实现了高控制优化,保持了处理要求.
- 与BSM1基准控制器相比,TD3减少了14.3%的通风和能源.
- TD3的表现优于以氨为基础的通风控制策略.
结论:
- TD3算法显示了废水处理节能的巨大潜力.
- 强化学习为活性污泥系统提供了传统控制策略的可行替代方案.
- 需要进一步的研究来提高强化学习实施的稳定性.
更多相关视频
05:40Comparison of Scale in a Photosynthetic Reactor System for Algal Remediation of Wastewater
Published on: March 6, 2017
9.1K
07:50A Method for Evaluating the Reinforcing Properties of Ethanol in Rats without Water Deprivation, Saccharin Fading or Extended Access Training
Published on: January 29, 2017
9.7K
相关概念视频
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
81
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
81
Feedback control systems
350
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
350
Open and closed-loop control systems
824
Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
824
Operant Conditioning Intervention
88
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...
88
