Development and external evaluation of predictions models for mortality of COVID-19 patients using machine learning

Simin Li1, Yulan Lin2, Tong Zhu1

  • 1Yidu Cloud Technology Inc., 8F, Health Work, No. 9 Building, No. 35 of Huayuan North Road, Haidian District, Beijing, 100089 China.

Insights

The Gradient Boosting Decision Tree (GBDT) model shows superior performance in predicting coronavirus disease 2019 (COVID-19) patient mortality compared to logistic regression models. This finding aids in better patient management and resource allocation during the pandemic.

Area of Science:

  • Medical Informatics
  • Machine Learning in Medicine
  • Epidemiology

Background:

  • Coronavirus disease 2019 (COVID-19) poses a significant global health challenge.
  • Accurate mortality prediction is crucial for patient management and healthcare resource allocation.
  • Existing predictive models require evaluation and comparison for optimal clinical utility.

Purpose of the Study:

  • To develop and compare machine learning models for predicting COVID-19 patient mortality.
  • To evaluate the performance of Gradient Boosting Decision Tree (GBDT) and logistic regression (LR) models.
  • To identify key clinical factors influencing COVID-19 mortality prediction.

Main Methods:

  • Clinical data from 2924 COVID-19 patients in Wuhan, China (January 18 - March 29, 2020) were analyzed.
  • Gradient Boosting Decision Tree (GBDT), logistic regression (LR), and a simplified LR model (LR-5) were constructed.
  • Model performance was assessed using fivefold cross-validation, calculating Area Under Curve (AUC), accuracy, Positive Predictive Value (PPV), and Negative Predictive Value (NPV).

Main Results:

  • The GBDT model achieved the highest fivefold AUC (0.941), outperforming LR (0.928) and LR-5 (0.913).
  • GBDT demonstrated superior diagnostic accuracy (0.889) and sensitivity (0.899) compared to LR models.
  • External validation identified leukomonocyte percentage, urea, age, and SpO2 as significant predictors in a separate cohort.

Conclusions:

  • The GBDT model offers enhanced accuracy for predicting COVID-19 mortality compared to traditional LR models.
  • Machine learning approaches, particularly GBDT, show promise for improving prognostic assessments in infectious diseases.
  • The study highlights the importance of robust model evaluation for clinical decision support systems.

Related Concept Videos

Steps in Outbreak Investigation01:18

Steps in Outbreak Investigation

In the ever-evolving field of public health, statistical analysis serves as a cornerstone for understanding and managing disease outbreaks. By leveraging various statistical tools, health professionals can predict potential outbreaks, analyze ongoing situations, and devise effective responses to mitigate impact. For that to happen, there are a few possible stages of the analysis:
350
Cancer Survival Analysis01:21

Cancer Survival Analysis

Cancer survival analysis focuses on quantifying and interpreting the time from a key starting point, such as diagnosis or the initiation of treatment, to a specific endpoint, such as remission or death. This analysis provides critical insights into treatment effectiveness and factors that influence patient outcomes, helping to shape clinical decisions and guide prognostic evaluations. A cornerstone of oncology research, survival analysis tackles the challenges of skewed, non-normally...
529
Kaplan-Meier Approach01:24

Kaplan-Meier Approach

The Kaplan-Meier estimator is a non-parametric method used to estimate the survival function from time-to-event data. In medical research, it is frequently employed to measure the proportion of patients surviving for a certain period after treatment. This estimator is fundamental in analyzing time-to-event data, making it indispensable in clinical trials, epidemiological studies, and reliability engineering. By estimating survival probabilities, researchers can evaluate treatment effectiveness,...
398
Comparing the Survival Analysis of Two or More Groups01:20

Comparing the Survival Analysis of Two or More Groups

Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
405