Machine learning-based risk stratification for gastrointestinal bleeding in ICU patients with cirrhosis: evidence
Yuxin Duan1, Weifan Sui1, Zefeng Cai1
1Department of Interventional Radiology, The Affiliated People's Hospital of Jiangsu University, Zhenjiang, Jiangsu, China.
Insights
A machine learning model accurately predicts gastrointestinal bleeding (GIB) in intensive care unit (ICU) patients with cirrhosis. Anticoagulant therapy was found to be protective, reducing GIB risk in these high-risk patients.
Area of Science:
- Critical Care Medicine
- Machine Learning in Healthcare
- Gastroenterology
Background:
- Gastrointestinal bleeding (GIB) is a frequent and serious complication for critically ill patients with cirrhosis in the ICU.
- Early identification of patients at high risk for GIB is essential for timely interventions and improved outcomes.
Purpose of the Study:
- To develop and validate a machine learning (ML) model for predicting in-hospital GIB in ICU patients with cirrhosis.
- To identify key predictors of GIB and assess the model's clinical utility for risk stratification.
Main Methods:
- Retrospective cohort study using MIMIC-IV and EICU databases (3,160 and 523 ICU patients with cirrhosis, respectively).
- Six ML algorithms were trained and evaluated; Random Forest (RF) was selected.
- Variable importance was determined using Boruta algorithm, correlation analysis, and VIF; SHAP analysis was used for interpretation. Multivariable logistic regression analyzed anticoagulant therapy's impact.
Main Results:
- The RF model achieved an AUC of 0.86 in the training cohort and 0.72 in the test cohort, with good sensitivity and specificity.
- Key predictors included red blood cell count, hemoglobin, platelet count, and anticoagulant therapy.
- Anticoagulant use was independently associated with a significantly lower risk of in-ICU GIB (OR: 0.29).
Conclusions:
- The developed RF model demonstrates robust performance in predicting GIB risk in ICU patients with cirrhosis.
- The model utilizes readily available clinical data, facilitating timely risk stratification and personalized preventive strategies in critical care.
Background:
In critically ill patients with cirrhosis, gastrointestinal bleeding (GIB) is a common complication that significantly impacts clinical outcomes during ICU hospitalization. Early identification of high-risk patients is crucial for preventing complications and guiding appropriate clinical interventions, which can improve treatment outcomes.
Objective:
To develop and externally validate a machine learning model for predicting in-hospital GIB in ICU patients with cirrhosis, identify key predictors, and assess its clinical utility for risk stratification and decision-making.
Methods:
A retrospective cohort study was conducted, including 3,160 ICU patients diagnosed with cirrhosis from the Medical Information Mart for Intensive Care IV (MIMIC-IV) database. Patients were divided chronologically into training (n = 2,528) and testing (n = 632) cohorts based on their ICU admission dates. External validation was performed on a separate cohort of 523 ICU patients with cirrhosis extracted from the publicly available Electronic Intensive Care Unit (EICU) database. Key predictive variables were identified through a combination of the Boruta algorithm, correlation analysis, and variance inflation factor (VIF) assessment, ensuring both predictive relevance and control of multicollinearity. Six ML algorithms-logistic regression, k-nearest neighbors, support vector machine, random forest (RF), multilayer perceptron, extreme gradient boosting, and gradient boosting machine-were trained and evaluated through 10-fold cross-validation. Model performance was rigorously assessed based on the area under the receiver operating characteristic curve (AUC-ROC), accuracy, sensitivity, specificity, F1-score, calibration curves, and decision curve analysis (DCA). Shapley additive explanations (SHAP) analysis was employed to interpret and rank variable importance. Additionally, multivariable logistic regression models were constructed to elucidate the relationship between anticoagulant therapy and the incidence of in-ICU GIB after comprehensive adjustment for relevant clinical factors.
Results:
Among the ML algorithms evaluated, the RF model achieved AUC of 0.86 (95% CI: 0.84-0.88) in the training cohort and 0.72 (95% CI: 0.68-0.76) in the test cohort, with sensitivity 0.68, specificity 0.71, and precision 0.47. The key predictors identified by the model included red blood cell count, hemoglobin level, platelet count, and anticoagulant therapy, all of which were significantly associated with the risk of gastrointestinal bleeding. Decision curve analysis indicated that the RF model provides meaningful clinical utility for early risk stratification. Multivariable logistic regression further revealed that anticoagulant use independently correlated with a lower risk of in-ICU GIB (or: 0.29; 95% confidence interval: 0.24-0.34). Stratified analyses based on gender, age, weight, and additional subgroups consistently confirmed the robustness of the protective association between anticoagulant therapy and reduced GIB risk.
Conclusion:
The RF model demonstrated stable discrimination for predicting GIB risk in ICU patients with cirrhosis across multiple cohorts. Built on readily available clinical data, it enables timely risk stratification and informs individualized preventive interventions in critical care settings.
