Related Experiment Video
Updated: Jul 8, 2026

Decomposing the Variance in Reading Comprehension to Reveal the Unique and Common Effects of Language and Decoding
Published on: October 11, 2018
The exact variance of weighted kappa with multiple raters
Paul W Mielke1, Kenneth J Berry, Janis E Johnston
1Department of Statistics, Colorado State University, Fort Collins, CO 80523-1877, USA. mielke@lamar.colostate.edu
Abstract:
Weighted kappa described by Cohen in 1968 is widely used in psychological research to measure agreement between two independent raters. Everitt then provided the exact variance for weighted kappa for two raters. In this paper, Everitt's exact variance is extended to three or more raters.
Related Concept Videos
Kendall's Coefficient of Concordance
One-Way ANOVA: Equal Sample Sizes
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Friedman Two-way Analysis of Variance by Ranks
Variance
One-Way ANOVA: Unequal Sample Sizes
Variation
When independent and dependent variables are plotted on a scatter plot, the slope of a line is a value that describes the rate of change between the two...

