Related Experiment Video
Updated: Aug 24, 2025

Hydra, a Computer-Based Platform for Aiding Clinicians in Cardiovascular Analysis and Diagnosis
Published on: September 26, 2018
Monitoring policy in the context of preventive treatment of cardiovascular disease
Daniel F Otero-Leon1, Mariel S Lavieri2, Brian T Denton2
1Department of Industrial and Operations Engineering, University of Michigan, Ann Arbor, MI, 48109, USA. dfotero@umich.edu.
Insights
This study introduces a Markov decision process to optimize patient monitoring for chronic disease prevention. It aims to balance cost and care by determining ideal monitoring schedules, considering factors like gender and race.
Area of Science:
- Health Informatics
- Chronic Disease Management
- Medical Decision Making
Background:
- Preventing chronic diseases requires effective monitoring of risk factors and timely medication.
- Current monitoring policies may be suboptimal, leading to unnecessary costs or adverse events.
- Patient-specific factors like demographics influence optimal monitoring strategies.
Purpose of the Study:
- To develop an optimal patient monitoring policy for chronic disease prevention.
- To utilize electronic health records data for modeling patient risk.
- To investigate the impact of gender and race on monitoring policies.
Main Methods:
- A finite horizon and finite-state Markov decision process was proposed.
- Stochastic models were estimated using longitudinal observational data from the U.S. Veterans Affairs health system.
- The model was applied to cholesterol-lowering medication assessment and demographic factor analysis.
Main Results:
- The study established a framework for optimizing monitoring frequency based on patient risk factors.
- The model demonstrated how to balance the costs of frequent monitoring against the risks of infrequent monitoring.
- Initial investigations into the influence of gender and race on optimal policies were conducted.
Conclusions:
- A data-driven Markov decision process can inform personalized chronic disease monitoring strategies.
- Optimized monitoring can improve healthcare efficiency and patient outcomes.
- Further research is needed to fully elucidate the role of demographic factors in monitoring policies.
Abstract:
Preventing chronic diseases is an essential aspect of medical care. To prevent chronic diseases, physicians focus on monitoring their risk factors and prescribing the necessary medication. The optimal monitoring policy depends on the patient's risk factors and demographics. Monitoring too frequently may be unnecessary and costly; on the other hand, monitoring the patient infrequently means the patient may forgo needed treatment and experience adverse events related to the disease. We propose a finite horizon and finite-state Markov decision process to define monitoring policies. To build our Markov decision process, we estimate stochastic models based on longitudinal observational data from electronic health records for a large cohort of patients seen in the national U.S. Veterans Affairs health system. We use our model to study policies for whether or when to assess the need for cholesterol-lowering medications. We further use our model to investigate the role of gender and race on optimal monitoring policies.
Related Concept Videos
Coronary Artery Disease IV: Preventive Measures
Atherosclerosis III: Management
Preventive Healthcare Services
Coronary Artery Disease V: Interprofessional Care
Hypertension IV: Drug Therapy and Lifestyle Modifications
Pulse rhythm
Conversely, an irregular pulse pattern is termed dysrhythmia, stemming from disruptions in cardiac...

