Mitigating epidemic spread in complex networks based on deep reinforcement learning
Jie Yang1, Wenshuang Liu1, Xi Zhang1
1School of Automation, Beijing Institute of Technology, Beijing 100081, China.
Chaos (Woodbury, N.Y.)
|December 19, 2024
Summary
This study uses deep reinforcement learning (DRL) to identify optimal quarantine targets in complex networks, balancing epidemic control with economic costs. The DRL strategy effectively mitigates contagion spread, with diminishing returns beyond a critical quarantine scale.
Area of Science:
- Network Science
- Epidemiology
- Computational Science
Background:
- Complex networks are vulnerable to contagious cascades, necessitating efficient epidemic mitigation.
- Physical quarantine is effective but can incur significant economic costs if not strategically implemented.
Purpose of the Study:
- To develop an innovative, cost-effective strategy for selecting quarantine targets in complex networks.
- To minimize both epidemic spread and quarantine-related economic repercussions.
Main Methods:
- Modeling epidemic spread using Markov chains with stochastic transitions and node quarantines.
- Employing deep reinforcement learning (DRL), specifically the proximal policy optimization algorithm, to train a quarantine strategy.
- Conducting simulations on synthetic and real-world network datasets.
Main Results:
- The DRL-based quarantine strategy effectively controls epidemic spread in complex networks.
- A non-linear relationship was observed between the daily maximum quarantine scale and mitigation effect, showing diminishing returns after a critical threshold.
- The strategy successfully balances infection rate reduction with quarantine costs.
Conclusions:
- Deep reinforcement learning offers a powerful approach for optimizing epidemic mitigation strategies in complex networks.
- Understanding the non-linear impact of quarantine scale is vital for efficient resource allocation and policy-making.
- The proposed method provides a framework for economically viable epidemic response planning.
Related Concept Videos
Steps in Outbreak Investigation
105
In the ever-evolving field of public health, statistical analysis serves as a cornerstone for understanding and managing disease outbreaks. By leveraging various statistical tools, health professionals can predict potential outbreaks, analyze ongoing situations, and devise effective responses to mitigate impact. For that to happen, there are a few possible stages of the analysis:
105
Real-World Application of Classical Conditioning
521
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
521
Confounding in Epidemiological Studies
143
Confounding in statistical epidemiology represents a pivotal challenge, referring to the distortion in the perceived relationship between an exposure and an outcome due to the presence of a third variable, known as a confounder. This variable is associated with both the exposure and the outcome but is not a direct link in their causal chain. Its presence can lead to erroneous interpretations of the exposure's effect, either exaggerating or underestimating the true association. This...
143


