Related Experiment Video
Updated: Oct 16, 2025

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
Published on: September 10, 2018
A Markov Decision Process Approach for Cost-Benefit Analysis of Infrastructure Resilience Upgrades
Qianru Zhu1, Benjamin D Leibowicz1
1Graduate Program in Operations Research and Industrial Engineering, The University of Texas at Austin, Austin, TX, USA.
Abstract:
As climate change threatens to cause increasingly frequent and severe natural disasters, decisionmakers must consider costly investments to enhance the resilience of critical infrastructures. Evaluating these potential resilience improvements using traditional cost-benefit analysis (CBA) approaches is often problematic because disasters are stochastic and can destroy even hardened infrastructure, meaning that the lifetimes of investments are themselves uncertain. In this article, we develop a novel Markov decision process (MDP) model for CBA of infrastructure resilience upgrades that offer prevention (reduce the probability of a disaster) and/or protection (mitigate the cost of a disaster) benefits. Stochastic features of the model include disaster occurrences and whether or not a disaster terminates the effective life of an earlier resilience upgrade. From our MDP model, we derive analytical expressions for the decisionmaker's willingness to pay (WTP) to enhance infrastructure resilience, and conduct a comparative static analysis to investigate how the WTP varies with the fundamental parameters of the problem. Following this theoretical portion of the article, we demonstrate the applicability of our MDP framework to real-world decision making by applying it to two case studies of electric utility infrastructure hardening. The first case study considers elevating a flood-prone substation and the second assesses upgrading transmission structures to withstand high winds. Results from these two case studies show that assumptions about the value of lost load during power outages and the distribution of customer types significantly influence the WTP for the resilience upgrades and are material to the decisions of whether or not to implement them.
Related Concept Videos
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
Design Example: Analyzing Capacity Contours for Flood Risk Assessment
Design Example: Alignment of a Road Line Using GIS
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Design Consideration
The factor of safety is another key...
Framing Effects

