Related Experiment Video
Updated: Dec 6, 2025

Applicability Analysis of Assessment Methods for Morphological Parameters of Corroded Steel Bars
Published on: November 1, 2018
Condition-Based Maintenance with Reinforcement Learning for Dry Gas Pipeline Subject to Internal Corrosion.
Zahra Mahmoodzadeh1, Keo-Yuan Wu2, Enrique Lopez Droguett3
1Department of Electrical and Computer Engineering and the B. John Garrick Institute for the Risk Sciences, University of California, Los Angeles-UCLA, Los Angeles, CA 90095, USA.
This study introduces reinforcement learning (RL) for managing gas pipeline corrosion. Applying RL-based maintenance can significantly cut costs by up to 58% while ensuring pipeline safety.
Area of Science:
- Engineering
- Artificial Intelligence
- Materials Science
Background:
- Gas pipeline systems are critical global energy infrastructure, facing risks like corrosion.
- Corrosion in pipelines leads to significant risks, including ruptures and environmental leakage.
- Corrosion-related maintenance constitutes a substantial operational cost for pipeline systems.
Purpose of the Study:
- To investigate the application of reinforcement learning (RL) for optimizing corrosion-related maintenance in dry gas pipelines.
- To develop a simulated testbed for modeling corrosion degradation and RL interaction.
- To propose a data-driven, condition-based maintenance management approach using RL.
Main Methods:
- Development of a simulated test bench modeling pipeline corrosion within an RL environment.
- Implementation of a condition-based maintenance management strategy driven by RL.
- Application of an RL maintenance scheduler to the proposed test bench.
Main Results:
- The proposed RL-based condition-based maintenance management reduced maintenance costs by up to 58% compared to periodic maintenance.
- The RL approach effectively managed corrosion degradation and ensured pipeline reliability.
- The developed test bench successfully simulated corrosion and facilitated RL-based decision-making.
Conclusions:
- Reinforcement learning offers a powerful, data-driven methodology for optimizing pipeline maintenance strategies.
- Condition-based maintenance informed by RL can lead to substantial cost savings and enhanced operational safety.
- The proposed RL framework provides a viable solution for proactive corrosion management in gas pipelines.
Related Concept Videos
Corrosion of Reinforcement
However, over time and under certain conditions like carbonation, chloride ingress, and cracking this protective state can be compromised. Steel has areas with...
Minor Losses in Pipes
Valves play a significant role in generating minor losses by obstructing or redirecting the fluid flow. When a valve is closed or partially closed, it restricts the flow...
Corrosion
Major Losses in Pipes
Fluid flow can be classified as laminar or turbulent, primarily based on the Reynolds number. This dimensionless number reflects the relative influence of inertial to viscous...
Reinforcement Schedules
Once a behavior is learned,...
Pipe Flowrate Measurement: Problem Solving

