Related Experiment Video
Updated: Aug 9, 2026

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
Published on: June 12, 2019
Measurement of interrater agreement with adjustment for covariates
1Center for Health Studies, Group Health Cooperative, 1730 Minor Avenue, Suite 1600, Seattle, Washington 98101-1448, USA.
Abstract:
The kappa coefficient measures chance-corrected agreement between two observers in the dichotomous classification of subjects. The marginal probability of classification by each rater may depend on one or more confounding variables, however. Failure to account for these confounders may lead to inflated estimates of agreement. A multinomial model is used that assumes both raters have the same marginal probability of classification, but this probability may depend on one or more covariates. The model may be fit using software for conditional logistic regression. Additionally, likelihood-based confidence intervals for the parameter representing agreement may be computed. A simple example is discussed to illustrate model-fitting and application of the technique.
Related Concept Videos
Introduction to Test of Independence
The test statistic for a test of independence is similar to that of a goodness-of-fit test:
Coefficient of Correlation
If you suspect a linear relationship between x and y, then r can measure how strong the linear relationship is.
What the VALUE of r tells us:
The value of r is always between –1 and +1: –1 ≤ r ≤ 1.
The size of the correlation r indicates the strength of the linear...
Variation
When independent and dependent variables are plotted on a scatter plot, the slope of a line is a value that describes the rate of change between the two...
Calibration Curves: Correlation Coefficient
Variability: Analysis
The range is a simple measure of variability, indicating the difference between the highest and...
Kendall's Coefficient of Concordance

