Related Experiment Video
Updated: Sep 12, 2026

Identification of Disease-related Spatial Covariance Patterns using Neuroimaging Data
Published on: June 26, 2013
Dependence of weighted kappa coefficients on the number of categories
1Department of Epidemiology, University of Ulm, Germany.
Abstract:
Weighted kappa coefficients are commonly used to quantify inter- or intra-rater reliability or test-retest reliability of ordinal ratings in clinical and epidemiologic applications. In this paper, we assess the dependence of weighted kappa coefficients on the number of categories and the type of weighting scheme, which vary between applications. The most commonly used weights are weights that are proportional to the deviation of individual ratings ("linear weights") or to the square of the deviation of individual ratings ("quadratic weights"). Quadratically weighted kappa coefficients are equivalent to the intraclass correlation coefficient and to the product-moment correlation coefficient under certain conditions. We illustrate that an increase of quadratically weighted kappa coefficients with the number of categories is expected under a broad variety of conditions, whereas linearly weighted kappa coefficients appear to be less sensitive to the number of categories. Number of categories and type of weighting scheme therefore require careful consideration in the interpretation of weighted kappa coefficients.
More Related Videos
Related Concept Videos
Weighted Mean
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
Expected Frequencies in Goodness-of-Fit Tests
Introduction to Test of Independence
The test statistic for a test of independence is similar to that of a goodness-of-fit test:
Hypothesis Test for Test of Independence
H0: The two variables (factors)...
Kendall's Tau Test
A τ value of +1 indicates that...
Kendall's Coefficient of Concordance

