Related Experiment Video
Updated: Aug 30, 2025

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
Performance of universal early warning scores in different patient subgroups and clinical settings: a systematic
Baneen Alhmoud1, Timothy Bonnici1,2, Riyaz Patel2,3,4
1Institute of Health Informatics, University College London, London, UK.
Objective:
To assess predictive performance of universal early warning scores (EWS) in disease subgroups and clinical settings.
Design:
Systematic review.
Data Sources:
Medline, CINAHL, Embase and Cochrane database of systematic reviews from 1997 to 2019.
Inclusion Criteria:
Randomised trials and observational studies of internal or external validation of EWS to predict deterioration (mortality, intensive care unit (ICU) transfer and cardiac arrest) in disease subgroups or clinical settings.
Results:
We identified 770 studies, of which 103 were included. Study designs and methods were inconsistent, with significant risk of bias (high: n=16 and unclear: n=64 and low risk: n=28). There were only two randomised trials. There was a high degree of heterogeneity in all subgroups and in national early warning score (I2=72%-99%). Predictive accuracy (mean area under the curve; 95% CI) was highest in medical (0.74; 0.74 to 0.75) and surgical (0.77; 0.75 to 0.80) settings and respiratory diseases (0.77; 0.75 to 0.80). Few studies evaluated EWS in specific diseases, for example, cardiology (n=1) and respiratory (n=7). Mortality and ICU transfer were most frequently studied outcomes, and cardiac arrest was least examined (n=8). Integration with electronic health records was uncommon (n=9).
Conclusion:
Methodology and quality of validation studies of EWS are insufficient to recommend their use in all diseases and all clinical settings despite good performance of EWS in some subgroups. There is urgent need for consistency in methods and study design, following consensus guidelines for predictive risk scores. Further research should consider specific diseases and settings, using electronic health record data, prior to large-scale implementation.
Prospero Registration Number:
PROSPERO CRD42019143141.
More Related Videos
11:05SECONDs Administration Guidelines: A Fast Tool to Assess Consciousness in Brain-injured Patients
Published on: February 6, 2021
10:38Observational Study Protocol for Repeated Clinical Examination and Critical Care Ultrasonography Within the Simple Intensive Care Studies
Published on: January 16, 2019