Related Experiment Video
Updated: May 23, 2025
E-Patient Counseling Trial E-PACO: Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
Published on: August 1, 2019
Reliability of pre-admission patient-reported outcome measures postoperatively assessed via proxies: a prospective,
Julius J Grunow1, Leonie Hartmann1, Bernhard Ulm2,3
1Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt Universität zu Berlin, Department of Anaesthesiology and Intensive Care Medicine (CCM/CVK), Charitéplatz 1, 10117, Berlin, Germany.
Background:
Pre-admission status obtained through patient-reported outcome measures is an essential metric in both clinical and research settings for prognostication and treatment decisions. It is frequently collected by proxies, although its reliability has yet to be thoroughly investigated. The objective was to determine the reliability of proxy assessments regarding pre-ICU admission status via patient-reported outcome measures and to explore the impact of the ICU setting on these assessments.
Methods:
Prospective multicentre observational study in two tertiary care university hospitals in Germany, including surgical adult patients able to independently answer the patient-reported outcome measures (SF-36, EQ-5D-5L, WHODAS 2.0, IADL, and Barthel Index) with a proxy available. Patients were interviewed pre-operatively, while proxies were interviewed post-operatively in the ICU or normal ward, depending on the patient's location. The reliability of patient-reported outcome measures was analyzed using Bland-Altman plots and Cohen's kappa.
Results:
Of 204 patient-proxy pairs, 102 were admitted to an ICU. The median patient and proxy age were 69 and 64 years, with 41% and 68% female, respectively. Bland-Altman plots demonstrated insufficient reliability of proxy ratings, as the 95% limits of agreement fell outside the minimal clinically important difference (MCID) for all questionnaires. However, a significant bias was evident only among ICU patients, showing worse ratings from proxies for the WHODAS 2.0, IADL, and subsets of the SF-36. For the EQ-5D, bias appeared in both the ICU and non-ICU cohorts. The dichotomous analysis of the within-pairs-difference supported the findings, revealing a high proportion of pairs with differences outside the MCID (n (%)-SF-36 PCS normal ward: 47 (46%), ICU: 58 (57%); SF-36 MCS normal ward: 59 (58%), ICU: 62 (61%); WHODAS 2.0 normal ward: 58 (57%), ICU: 78 (77%); EQ-5D-5L normal ward: 40 (39%), ICU: 46 (45%); Barthel-Index normal ward: 22 (22%), ICU: 21 (21%)). Cohen's kappa indicated moderate reliability for the IADL.
Conclusion:
The reliability of proxy assessment with the instruments used was insufficient, exhibiting a significant bias in the pre-admission status of ICU patients; therefore, it should be applied with caution.
Trial Registration:
ClinicalTrials.gov (NCT03785444-28th of December 2018).
Related Concept Videos
01:11Guidelines for Writing Outcome
Patient outcomes reflect the patient's response to the goal rather than what the nurse aims to achieve. Terminology should be observable and measurable to avoid the reader's interpretation. The desired outcome should be realistic and achievable in the designated care timeframe. Expected outcomes should align with adjunctive therapies. The outcome should enhance care...
01:11Observational Studies
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One...
02:07Blind Procedures