Related Experiment Video
Updated: Aug 6, 2026

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
Published on: June 12, 2019
Interrater reliability of measurements of comorbid illness should be reported
Stephen F Hall1, Patti A Groome, David L Streiner
1Department of Otolaryngology, Queen's University, and Division of Cancer Care and Epidemiology, Queen's Cancer Research Institute, Queen's University, Kingston, Ontario, Canada. sfh@post.queensu.ca
Objective:
Comorbidity indices are commonly used to stratify patients to control for treatment selection bias. The objectives here were to review the reporting of interrater reliability when studies use comorbidity indices in clinical research publications and to report the interrater reliability of four common indices in a particular research setting.
Study Design And Setting:
Four trained abstractors reviewed the same 40 charts of patients with squamous cell carcinoma of the head and neck from a regional cancer center. Scores for the Charlson Index, the Index of Co-existent Disease, the Cumulative Illness Rating Scale, and the Kaplan-Feinstein Classification were calculated, and the intraclass correlation coefficient was used to assess interrater reliability.
Results:
The details on the training of abstractors and the results of interrater reliability tests are not commonly reported. In our study setting, the Charlson Index had excellent reliability and the others had acceptable reliability.
Conclusion:
If the quality of a study using an index or scale is to be assessed, the reliability and interrater reliability of the score assignment process should be reported.
Related Concept Videos
Reliability and Validity
Bias in Epidemiological Studies
Errors occurring during blood pressure monitoring
Several factors...
Confounding in Epidemiological Studies
Statistical Analysis: Overview
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
Coefficient of Correlation
If you suspect a linear relationship between x and y, then r can measure how strong the linear relationship is.
What the VALUE of r tells us:
The value of r is always between –1 and +1: –1 ≤ r ≤ 1.
The size of the correlation r indicates the strength of the linear...