External validation of the REMEMBER score

Armin Darius Peivandi1, Henryk Welp1, Sebastian Kintrup2

  • 1Department of Cardiothoracic Surgery, University Hospital Muenster, Muenster, Germany.

Insights

The REMEMBER score, designed to predict mortality after coronary artery bypass grafting (CABG) with venoarterial extracorporeal membrane oxygenation (VA-ECMO), showed poor performance in external validation. This score is not applicable for predicting in-hospital mortality in this patient group.

Area of Science:

  • Cardiology
  • Cardiovascular Surgery
  • Critical Care Medicine

Background:

  • Venoarterial extracorporeal membrane oxygenation (VA-ECMO) use after coronary artery bypass grafting (CABG) is linked to high in-hospital mortality.
  • The REMEMBER score was developed to predict in-hospital mortality in CABG patients requiring VA-ECMO.

Purpose of the Study:

  • To externally validate the predictive performance of the REMEMBER score in a distinct cohort of CABG patients who underwent VA-ECMO.
  • To assess the REMEMBER score's accuracy in predicting in-hospital mortality.

Main Methods:

  • Retrospective analysis of 107 CABG patients who received VA-ECMO between 2012 and 2021.
  • Evaluation of the REMEMBER score's discriminative ability using concordance statistics and ROC curve analysis.
  • Assessment of calibration using calibration-in-the-large and calibration slope.

Main Results:

  • The study included 107 patients, with an in-hospital mortality rate of 45.8%.
  • The REMEMBER score demonstrated low discriminative ability (AUC: 0.623) and poor calibration (intercept p=0.0195, slope p=0.0303).
  • The median predicted mortality rate by the REMEMBER score was 52%, differing from the observed rate.

Conclusions:

  • The REMEMBER score was found to be inaccurate and not applicable for predicting in-hospital mortality in this cohort of CABG patients treated with VA-ECMO.
  • Further external validation studies, preferably in a multicenter setting, are recommended to confirm these findings.
Abstract

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.8K
Self-Evaluation: Self-Enhancement and Self-Verification03:00

Self-Evaluation: Self-Enhancement and Self-Verification

Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.2K
Confidence Coefficient01:24

Confidence Coefficient

The confidence coefficient is also known as the confidence level or degree of confidence. It is the percent expression for the probability, 1-α, that the confidence interval contains the true population parameter assuming that the confidence interval is obtained after sufficient unbiased sampling; for example, if the CL = 90%, then in 90 out of 100 samples the interval estimate will enclose the true population parameter. Here α is the area under the curve, distributed equally under...
7.7K
Data Validation01:03

Data Validation

Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
5.1K
Statistical Significance01:50

Statistical Significance

Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.2K
z Scores and Unusual Values01:07

z Scores and Unusual Values

The z score is one of the three measures of relative standing. It describes the location of a value in a dataset relative to the mean. z scores are obtained after the standardization of the values in a dataset. The z score for the mean is 0.
 This score indicates how far a value is from the mean in terms of standard deviation. For example, if a data value has a z score of +1, the researcher can infer that the particular data value is one standard deviation above the mean. If another data...
9.9K