Related Experiment Video
Updated: Jul 6, 2026

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
Integrating the interpretable machine learning Score For Emergency Risk Prediction (SERP) with emergency department
Yvonne Wong Qi Feng1, Yohei Okada1,2,3, Stephanie Fook-Chong2
1Duke-NUS Medical School, Singapore.
Objective:
This study integrates a machine learning (ML) based Score for Emergency Risk Prediction (SERP), developed using objective mortality endpoints with the Patient Acuity Category Scale (PACS) and evaluated its effectiveness in clinical use.
Methods:
This single-centre, retrospective cohort study included all ED patients from a large tertiary hospital between 1 January 2018 and 31 December 2019. Using a reclassification framework, SERP was incorporated into PACS to derive two enhanced triage models. PACS+ model 1 downtriaged patients with low predicted 30-day mortality risk and up-triaged those with high risk. PACS+ model 2 up-triaged only high-risk patients, while low-risk patients retained their original category. Predictive performance in the test cohort was assessed using the area under the receiver operating characteristic curve (AUC) and decision curve analysis (DCA).
Results:
The derivation cohort included 97,188 ED visits, and test cohort included 97,212 ED visits. In the derivation set, the mean (SD) age of patients was 58.97 (18.41) years old and 47,993 (49.4%) were females. Of all patients, 19.9%, 57.5%, 22.5%, and 0.2% were triaged to PACS categories 1-4 respectively. The 30-day mortality rate in the derivation set was 2.8% and 2.7% in the validation cohort. For 30-day mortality prediction, PACS+ model 1 (AUC 0.828 [95% CI 0.820-0.836]) and PACS+ model 2 (AUC 0.812 [95% CI 0.805-0.818]) outperformed PACS (AUC 0.722 [95% CI 0.714-0.729]). PACS+ model 1 consistently achieved greater net benefit across the range of clinical thresholds.
Conclusion:
Integrating ML-based SERP with PACS improved 30-day mortality prediction in ED triage.
Related Concept Videos
Receiver Operating Characteristic Plot
Survival Tree
Building a Survival Tree
Constructing a...