Related Experiment Video
Updated: Dec 2, 2025

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
Clinical Risk Prediction Scores in Coronavirus Disease 2019: Beware of Low Validity and Clinical Utility
Haamed Al Hassan1,2,3,4, Eve Cocks2, Lara Jesani2
1Cardiff and Vale University Health Board, Cardiff, United Kingdom, and Department of Anaesthesia, Intensive Care and Pain Medicine, Division of Population Medicine, Cardiff University, Cardiff, United Kingdom.
Insights
Three existing risk tools for predicting severe coronavirus disease 2019 (COVID-19) progression showed limited accuracy in external validation. Further research is needed to improve COVID-19 risk stratification for better patient outcomes.
Area of Science:
- Medical research
- Epidemiology
- Clinical informatics
Background:
- Several risk stratification tools have been developed for coronavirus disease 2019 (COVID-19) to predict disease progression.
- However, external validation of these tools is lacking, limiting their clinical applicability.
Purpose of the Study:
- To externally validate three previously published risk stratification tools for predicting severe COVID-19 outcomes.
- To assess the predictive performance of the COVID-GRAM score, CALL score, and a nomogram in a multicenter cohort.
Main Methods:
- A multicenter study involving 169 patients diagnosed with COVID-19.
- Data collected included patient demographics, comorbidities, and outcomes.
- Performance of risk stratification tools was evaluated using the area under the receiver operating characteristic curve (AUC).
Main Results:
- The COVID-GRAM score achieved an AUC of 0.636 (95% CI: 0.550-0.722).
- The CALL score demonstrated an AUC of 0.500 (95% CI: 0.411-0.589).
- The nomogram yielded an AUC of 0.628 (95% CI: 0.543-0.714).
Conclusions:
- The validated risk stratification tools exhibited suboptimal predictive performance for severe COVID-19 progression in this external cohort.
- The findings suggest a need for the development and validation of more accurate tools for COVID-19 risk stratification.
Abstract:
Several risk stratification tools were developed to predict disease progression in coronavirus disease 2019, with no external validation to date. We attempted to validate three previously published risk-stratification tools in a multicenter study. Primary outcome was a composite outcome of development of severe coronavirus disease 2019 disease leading to ICU admission or death censored at hospital discharge or 30 days. We collected data from 169 patients. Patients were 73 years old (59-82 yr old), 66 of 169 (39.1%) were female, 57 (33.7%) had one comorbidity, and 80 (47.3%) had two or more comorbidities. Area under the receiver operating characteristic curve (95% CI) for the COVID-GRAM score was 0.636 (0.550-0.722), for the CALL score 0.500 (0.411-0.589), and for the nomogram 0.628 (0.543-0.714).
Related Concept Videos
Imaging Studies for Cardiovascular System VI: Calcium -Scoring CT
Sensitivity, Specificity, and Predicted Value
Sensitivity is the...
Relative Risk
Receiver Operating Characteristic Plot
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Single Nucleotide Polymorphisms-SNPs

