提高深度强化学习在城市排水系统运行中的可解释性
Wenchong Tian1, Guangtao Fu2, Kunlun Xin3
1College of Environmental Science and Engineering, Tongji University, Shanghai 200092, PR China; Key Laboratory of Urban Water Supply, Water Saving and Water Environment Governance in the Yangtze River Delta of Ministry of Water Resources, Shanghai 200092, PR China.
Water research
|December 2, 2023
概括
本研究引入了一个框架,以提高对深度强化学习 (DRL) 对于城市排水系统 (UDS) 控制的理解. 这些方法提高了可解释性,促进了对实时控制的DRL应用程序的信任.
科学领域:
- 环境工程 环境工程
- 人工智能的人工智能
- 水资源管理 水资源管理
背景情况:
- 深度强化学习 (DRL) 为城市排水系统 (UDS) 提供了自适应实时控制 (RTC).
- DRL模型往往是黑子,阻碍了在UDS操作中的解释性和实际应用.
- 对UDS的DRL缺乏解释性会带来风险,并降低利益相关者之间的信任.
研究的目的:
- 开发和验证一个评估框架,用于分析和增强基于DRL的UDS操作的可解释性.
- 在UDS控制中比较不同DRL算法 (DQN,PPO) 的解释性和性能.
- 找出DRL控制策略可能无效的特定条件.
主要方法:
- 开发了一个评估框架,包括Sobol灵敏度分析,基于树的替代模型和条件概率分析.
- 通过深度Q学习网络 (DQN) 和近接政策优化 (PPO) 验证了用于UDS控制的框架.
- 训练有素的DRL代理人,以尽量减少结合下水道溢出 (CSO) 排放和洪水在现实世界的UDS.
主要成果:
- 在UDS管理中,DRL方法 (DQN,PPO) 的表现优于现有的基于规则的控制系统.
- 索博尔分析显示,DQN对连接流量和降雨的敏感性很高,而PPO对所有州都做出了回应.
- 替代模型显示PPO在控制逻辑中更容易理解,而DQN在控制逻辑中更具前性.
- 条件概率分析确定了DRL有效性有限的关键场景.
结论:
- 拟议的框架显著提高了UDS操作的DRL的可解释性.
- 改进的解释性促进了运营商和监管机构对DRL应用程序的更大信任和信心.
- 该研究为在现实世界城市排水管理中部署DRL提供了可操作的见解.
相关概念视频
Levels of Use of a GIS
53
Geographic Information Systems (GIS) operate across three levels of application, each representing an increasing degree of complexity: data management, analysis, and prediction. These levels reflect the expanding functionality and versatility of GIS technology in handling spatial data for diverse purposes.Data ManagementAt its foundational level, GIS serves as a tool for data management, enabling the input, storage, retrieval, and organization of spatial data. This level is often employed in...
53
Manipulation and Analysis
26
GIS manipulation and analysis functions are vital for decision-making and planning. These activities range from data retrieval tasks, such as selecting information based on specific criteria, to advanced analytical techniques that address complex spatial problems.One critical GIS analysis method is overlaying, which combines multiple data layers to examine impacts. For example, overlaying a river-dammed lake boundary with road networks can identify affected infrastructure. Another common...
26
Design Example: Analyzing Capacity Contours for Flood Risk Assessment
50
Flood risk assessment involves careful planning and analysis to ensure the safety of communities near water retention structures. Capacity contours are a vital tool in this process, as they illustrate the potential spread of water at specific levels in a given area. In the context of building a bund across a small valley, these contours play a critical role in evaluating the safety of nearby residential areas.In this example, the bund is intended to store stormwater in the valley. The engineers...
50
Typical Model Studies
361
Fluid mechanics model studies often utilize scaled-down systems to predict fluid behavior in full-scale environments, such as river flows, dam spillways, and structures interacting with open surfaces. Maintaining Froude number similarity in river models is crucial, as it replicates surface flow features like wave patterns and velocities.
361
Conservation of Mass in Moving, Nondeforming Control Volume
1.1K
Stormwater detention basins are essential in managing runoff during heavy rainfall, particularly in urban areas where impervious surfaces increase the risk of flooding. Understanding the conservation of mass in these systems allows engineers to optimize basin performance, balancing inflow, outflow, and water storage.
In the context of a detention basin, the conservation of mass states that the total mass of water entering the basin must equal the mass leaving the basin plus any accumulation of...
In the context of a detention basin, the conservation of mass states that the total mass of water entering the basin must equal the mass leaving the basin plus any accumulation of...
1.1K
Applications of GIS: Disaster Management and Emergency Response
88
Geographic Information System (GIS) technology is essential for risk identification, action prioritization, and resource optimization in critical situations like flooding and earthquakes. By integrating spatial and demographic data, GIS provides a comprehensive framework for emergency response.GIS integrates data layers, like rainfall intensity, topography, elevation profiles, and river levels, to model high-risk flood zones. These layers assess areas susceptible to flooding based on their...
88


