Resampling probability values for weighted kappa with multiple raters
Related Experiment Video
Updated: Jul 4, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
Paul W Mielke1, Kenneth J Berry, Janis E Johnston
1Department of Statistics, Colorado State University, Fort Collins, CO 80523-1877, USA. mielke@lamar.colostate.edu
Abstract:
A new procedure to compute weighted kappa with multiple raters is described. A resampling procedure to compute approximate probability values for weighted kappa with multiple raters is presented. Applications of weighted kappa are illustrated with an example analysis of classifications by three independent raters.
Related Concept Videos
Kendall's Coefficient of Concordance
Weighted Mean
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation
On...
Expected Frequencies in Goodness-of-Fit Tests
Kendall's Tau Test
A τ value of +1 indicates that...
One-Way ANOVA: Unequal Sample Sizes
