Related Experiment Video
Updated: Jan 24, 2026

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
Published on: June 12, 2019
Inter-rater reliability of CTCAE assessments with or without EORTC patient-reported outcome data in a mixed cancer
Lisa M Wintner1, Monika Sztankay1, Hikmat Abdel-Razeq2
1Department of Psychiatry, Psychotherapy, Psychosomatics and Medical Psychology, University Hospital of Psychiatry II, Medical University of Innsbruck, Innsbruck, Austria.
Background:
The Common Terminology Criteria for Adverse Events (CTCAE) is the standard for provider-based rating of adverse events in oncology, but its reliability for symptomatic adverse events is low. Patient-reported outcome (PRO) data might improve the inter-rater reliability of CTCAE assessments. We investigated whether providers' access to PRO data enhances the inter-rater reliability of CTCAE ratings and the detection of symptomatic adverse events.
Methods:
This multinational, open-label, randomised controlled trial was done in 11 hospitals in ten countries. Adults (aged ≥18 years) with any cancer diagnosis receiving chemotherapy, immunotherapy, or radiotherapy of curative or palliative intent were eligible. Patients were randomly assigned (1:1) to the intervention group (in which providers saw patients' PRO data as they were doing CTCAE assessments) or the control group (in which providers did not have access to PRO data) within each centre through a minimisation algorithm and a weighted cutoff; no additional stratification factors were applied. Patients completed the European Organisation for Research and Treatment of Cancer (EORTC) QLQ-C30 and 16 additional items from the EORTC Item Library, covering 17 symptomatic adverse events. Two independent providers (oncologists or trained nurses) did CTCAE ratings. The primary endpoint was the inter-rater reliability of CTCAE ratings, expressed as intraclass correlation coefficients (ICCs), for all patients with complete assessments. The trial was registered at ClinicalTrials.gov (NCT04066868) and is now closed.
Findings:
Between Feb 10, 2020, and Dec 6, 2024, a total of 1067 patients were enrolled (538 in the control group and 529 in the intervention group), with full data from 512 patients in the control group and 501 in the intervention group included in the analysis. Median age was 59 years (IQR 46-68); 558 (55·1%) of 1013 were female and 455 (44·9%) were male. Most had good functional status (403 [79%] of 512 had ECOG 0-1 in the control group and 371 [74%] of 501 in the intervention group). The most common cancer types were haematological (control group: 137 [27%] of 512; intervention group: 131 [26%] of 501), breast (control group: 118 [23%]; intervention group: 107 [21%]), and gastrointestinal (control group: 98 [19%]; intervention group: 89 [18%]). Inter-rater reliability was significantly higher in the intervention group for 13 of 17 symptomatic adverse events, with the largest differences for memory impairment (ICC 0·176; p<0·0001), irritability (0·161; p<0·0001), concentration impairment (0·157; p<0·0001), depression (0·126; p=0·0012), and anxiety (0·109; p=0·0018). There was no significant difference for pain, rash, and peripheral sensory neuropathy and the reliability was significantly higher in the control group than the intervention group for diarrhoea (ICC -0·066; p=0·013).
Interpretation:
Availability of PRO data to providers for CTCAE rating improves the consistency of provider-based symptomatic adverse event detection in patients with cancer. PRO data supports reliable assessment of treatment-related toxicity, highlighting the value of integrating PRO data into clinical evaluations within cancer trials.
Funding:
EORTC Quality of Life Group.
More Related Videos
09:53Labeling of Breast Cancer Patient-derived Xenografts with Traceable Reporters for Tumor Growth and Metastasis Studies
Published on: November 30, 2016
09:33Visualizing Field Data Collection Procedures of Exposure and Biomarker Assessments for the Household Air Pollution Intervention Network Trial in India
Published on: December 23, 2022
Related Concept Videos
Data Reporting and Recording
Reliability and Validity
Statistical Software for Data Analysis and Clinical Trials
Analysis of Population Pharmacokinetic Data
Assessment of the Gastrointestinal System I: Subjective Data
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
Assessment of the Cardiovascular System I: Subjective Data
Initial Enquiry
Ask the patient about their primary concern and thoroughly explore all reported symptoms.
Medical History
Investigate past illnesses affecting the cardiovascular system, such as angina, anemia, rheumatic fever, congenital heart disease, stroke, thrombophlebitis, dysrhythmias, varicosities
Inquire about symptoms...