Predicting 30-Day Readmissions in Patients With Heart Failure Using Administrative Data: A Machine Learning Approach

We sought to develop machine learning (ML) models trained on administrative data which predict risk of readmission in patients with heart failure and to evaluate and compare the ML model with the currently used LaCE score using clinically informative metrics.

This prognostic study was conducted in Alberta, Canada, on 9845 patients with confirmed heart failure admitted to hospital between 2012 and 2019. The outcome was unplanned all-cause hospital readmission within 30 days of discharge. We used 80% of the data for the ML model development and 20% for independent validation. We reported, using the validation set, c-statistics (area under the receiver operating characteristic curves)and performance metrics (likelihood ratio, positive predictive values) for the XGBoost model and a modified LaCE score within their respective predictive thresholds. Boosted tree-based classifiers had higher area under the receiver operating characteristic curves (0.65 for XGBoost) compared with others (0.58 for neural networks) and 0.57 for the modified LaCE. Within the predicted threshold range of the XGBoost classifier, the positive likelihood ratio was 1.00 at the low end of predicted risk and 6.12 at the high end, resulting in a positive predictive value (post-test probability) range of 21%-62%; the pretest probability of readmission was 20.9% using prevalence. The corresponding positive likelihood ratios and positive predictive values across LaCE score thresholds were 1.00-1.20 and 21%-24%, respectively.

Despite predicting readmissions better than the LaCE, even the best ML model trained on administrative health data (XGBoost) did not provide substantially informative prediction performance as it only generated a moderate shift from pre to post-test probability. Health systems wishing to deploy such a tool should consider training ML models with additional data. Adding other techniques like natural language processing, along with ML, to use other clinical information (like chart notes) might improve prediction performance.