Related Experiment Video
Updated: Jul 19, 2025

Using Practice Testing, Public Speaking, and Source Monitoring to Examine the Influences of Learning Strategies and Stress on Episodic Memory
Published on: June 14, 2019
External validation of the REMEMBER score
Armin Darius Peivandi1, Henryk Welp1, Sebastian Kintrup2
1Department of Cardiothoracic Surgery, University Hospital Muenster, Muenster, Germany.
Insights
The REMEMBER score, designed to predict mortality after coronary artery bypass grafting (CABG) with venoarterial extracorporeal membrane oxygenation (VA-ECMO), showed poor performance in external validation. This score is not applicable for predicting in-hospital mortality in this patient group.
Area of Science:
- Cardiology
- Cardiovascular Surgery
- Critical Care Medicine
Background:
- Venoarterial extracorporeal membrane oxygenation (VA-ECMO) use after coronary artery bypass grafting (CABG) is linked to high in-hospital mortality.
- The REMEMBER score was developed to predict in-hospital mortality in CABG patients requiring VA-ECMO.
Purpose of the Study:
- To externally validate the predictive performance of the REMEMBER score in a distinct cohort of CABG patients who underwent VA-ECMO.
- To assess the REMEMBER score's accuracy in predicting in-hospital mortality.
Main Methods:
- Retrospective analysis of 107 CABG patients who received VA-ECMO between 2012 and 2021.
- Evaluation of the REMEMBER score's discriminative ability using concordance statistics and ROC curve analysis.
- Assessment of calibration using calibration-in-the-large and calibration slope.
Main Results:
- The study included 107 patients, with an in-hospital mortality rate of 45.8%.
- The REMEMBER score demonstrated low discriminative ability (AUC: 0.623) and poor calibration (intercept p=0.0195, slope p=0.0303).
- The median predicted mortality rate by the REMEMBER score was 52%, differing from the observed rate.
Conclusions:
- The REMEMBER score was found to be inaccurate and not applicable for predicting in-hospital mortality in this cohort of CABG patients treated with VA-ECMO.
- Further external validation studies, preferably in a multicenter setting, are recommended to confirm these findings.
Background:
The use of venoarterial extracorporeal membrane oxygenation (VA-ECMO) after coronary artery bypass grafting (CABG) is associated with high in-hospital mortality rates. The pRedicting mortality in patients undergoing venoarterial Extracorporeal MEMBrane oxygenation after coronary artEry bypass gRafting (REMEMBER) score has been created to predict in-hospital mortality in this subgroup of patients. The aim of this study is to externally validate the REMEMBER score.
Methods:
All CABG patients who received VA-ECMO during or after the operation at our center between 01/2012 and 12/2021 were included in the analysis. Discrimination was assessed using concordance statistics, visualized by ROC curve analysis. Calibration-in-the-large and Calibration slope were tested separately.
Results:
A total of 107 patients (male: n = 78, 72.9%) were included in this study. The in-hospital mortality rate in our cohort was 45.8% compared with 55% in the original study. The REMEMBER score median predicted mortality rate was 52% (76.9-36%). However, the REMEMBER score showed low discriminative ability [AUC: 0.623 (p = 0.0244; 95% CI = 0.524-0.715)] and inaccurate calibration (intercept = 0.25074; p = 0.0195; slope = 0.39504; p = 0.0303), indicating poor performance.
Conclusions:
The REMEMBER score did not predict in-hospital mortality and was therefore not applicable in our cohort of patients. Additional external validation studies in a multicenter setting are therefore advisable.
Related Concept Videos
Reliability and Validity
Self-Evaluation: Self-Enhancement and Self-Verification
Confidence Coefficient
Data Validation
Nursing assessment guides are generally based on holistic models rather than medical...
Statistical Significance
z Scores and Unusual Values
This score indicates how far a value is from the mean in terms of standard deviation. For example, if a data value has a z score of +1, the researcher can infer that the particular data value is one standard deviation above the mean. If another data...

