Deep neural networks excel in COVID-19 disease severity prediction-a meta-regression analysis

COVID-19 is a disease in which early prognosis of severity is critical for desired patient outcomes and for the management of limited resources like intensive care unit beds and ventilation equipment. Many prognostic statistical tools have been developed for the prediction of disease severity, but it is still unclear which ones should be used in practice. We aim to guide clinicians in choosing the best available tools to make optimal decisions and assess their role in resource management and assess what can be learned from the COVID-19 scenario for development of prediction models in similar medical applications. Using the five major medical databases: MEDLINE (via PubMed), Embase, Cochrane Library (CENTRAL), Cochrane COVID-19 Study Register, and Scopus, we conducted a comprehensive systematic review of prediction tools between 2020 January and 2023 April for hospitalized COVID-19 patients. We identified both the relevant confounding factors of tool performance using the MetaForest algorithm and the best tools-comparing linear, machine learning, and deep learning methods-with mixed-effects meta-regression models. The risk of bias was evaluated using the PROBAST tool. Our systematic search identified eligible 27,312 studies, out of which 290 were eligible for data extraction, reporting on 430 independent evaluations of severity prediction tools with ~ 2.8 million patients. Neural Network-based tools have the highest performance with a pooled AUC of 0.893 (0.748-1.000), 0.752 (0.614-0.853) sensitivity, 0.914 (0.849-0.952) specificity, using clinical, laboratory, and imaging data. The relevant confounders of performance are the geographic region of patients, the rate of severe cases, and the use of C-Reactive Protein as input data. 88% of studies have a high risk of bias, mostly because of deficiencies in the data analysis. All investigated tools in use aid decision-making for COVID-19 severity prediction, but Machine Learning tools, specifically Neural Networks clearly outperform other methods, especially in cases when the basic characteristics of severe and non-severe patient groups are similar, and without the need for more data. When highly specific biomarkers are not available-such as in the case of COVID-19-practitioners should abandon general clinical severity scores and turn to disease specific Machine Learning tools.