Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Kendall's Coefficient of Concordance01:20

Kendall's Coefficient of Concordance

Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects or...
Kendall's Tau Test01:16

Kendall's Tau Test

Kendall's tau test, also known as the Kendall rank coefficient test, is a nonparametric method for assessing association between two variables. This test is particularly useful for identifying significant correlations when the distributions of the sample and population are unknown. Developed in 1938 by the British statistician Sir Maurice George Kendall, the tau coefficient (denoted as τ) serves as a rank correlation coefficient, with values ranging from -1 to +1.
A τ value of +1 indicates that...
Kruskal-Wallis Test01:19

Kruskal-Wallis Test

The Kruskal-Wallis test, also known as the Kruskal-Wallis H test, serves as a nonparametric alternative to the one-way ANOVA, offering a solution for analyzing the differences across three or more independent groups based on a single, ordinal-dependent variable. This statistical test is particularly valuable in scenarios where the data does not meet the normal distribution assumption required by its parametric counterparts. Kruskal-Wallis test is designed typically to handle ordinal data or...
Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures from...
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation01:24

One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation

This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...
Wilcoxon Rank-Sum Test01:21

Wilcoxon Rank-Sum Test

The Wilcoxon rank-sum test, also known as the Mann-Whitney U test, is a nonparametric test used to determine if there is a significant difference between the distributions of two independent samples. This test is designed specifically for two independent populations and has the following key requirements:

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Spatial-temporal association of soil Pb and children's blood Pb in the Detroit Tri-County Area of Michigan (USA).

Environmental research·2020
Same author

The concurrent decline of soil lead and children's blood lead in New Orleans.

Proceedings of the National Academy of Sciences of the United States of America·2019
Same author

Spatiotemporal exposome dynamics of soil lead and children's blood lead pre- and ten years post-Hurricane Katrina: Lead and other metals on public and private properties in the city of New Orleans, Louisiana, U.S.A.

Environmental research·2017
Same author

Spatiotemporal dynamic transformations of soil lead and children's blood lead ten years after Hurricane Katrina: New grounds for primary prevention.

Environment international·2016
Same author

Evolving from reactive to proactive medicine: community lead (Pb) and clinical disparities in pre- and post-Katrina New Orleans.

International journal of environmental research and public health·2014
Same author

Environmental and health disparities in residential communities of New Orleans: the need for soil lead intervention to advance primary prevention.

Environment international·2012
Same journal

Development and Measurement Properties of a Custom-Built Punch Force Dynamometer Based on S-Type Load Cells.

Perceptual and motor skills·2026
Same journal

Do Elite Taekwondo Athletes Invest Time for Better Choices? Analysis of Anticipatory Behavior Through a Perception-Action Coupling Task.

Perceptual and motor skills·2026
Same journal

Multisensory Contributions in Joint Actions: A Scoping Review.

Perceptual and motor skills·2026
Same journal

Proprioceptive Impairment and Joint Position Exposure Time in Relation to Patient-Report Outcome With Chronic Ankle Instability.

Perceptual and motor skills·2026
Same journal

Static Tactical Diagrams and Imagination: Differential Effects on Novice and Expert Handball Players.

Perceptual and motor skills·2026
Same journal

Autonomic Responses During Kinesthetic Motor Imagery in Healthy Adults: A Multimodal Assessment Using HRV and EDA.

Perceptual and motor skills·2026
See all related articles

Related Experiment Video

Updated: Jun 25, 2026

A Protocol of Manual Tests to Measure Sensation and Pain in Humans
07:28

A Protocol of Manual Tests to Measure Sensation and Pain in Humans

Published on: December 19, 2016

Weighted kappa for multiple raters.

Kenneth J Berry1, Janis E Johnston, Paul W Mielke

  • 1Department of Sociology, Colorado State University, Fort Collins, CO 80523-1784, USA. berry@lamar.colostate.edu

Perceptual and Motor Skills
|February 25, 2009
PubMed
Summary
This summary is machine-generated.

This study compares five methods for calculating weighted kappa probability with multiple raters. The resampling contingency method is the most versatile and accurate for assessing inter-rater reliability.

More Related Videos

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
08:40

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

Related Experiment Videos

Last Updated: Jun 25, 2026

A Protocol of Manual Tests to Measure Sensation and Pain in Humans
07:28

A Protocol of Manual Tests to Measure Sensation and Pain in Humans

Published on: December 19, 2016

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
08:40

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

Area of Science:

  • Statistics
  • Biostatistics
  • Psychometrics

Background:

  • Inter-rater reliability is crucial for data consistency.
  • Weighted kappa is a common metric for agreement, especially with ordinal data.
  • Calculating the probability of weighted kappa with multiple raters under independence is complex.

Purpose of the Study:

  • To describe and compare five procedures for calculating the probability of weighted kappa with multiple raters.
  • To evaluate these procedures based on accuracy, ease of use, generality, and limitations.
  • To identify the most suitable procedure for various research scenarios.

Main Methods:

  • Exact variance procedure
  • Resampling contingency procedure
  • Intraclass correlation procedure
  • Randomized block procedure
  • Resampling block procedure

Main Results:

  • All five procedures have distinct strengths and limitations.
  • The resampling contingency procedure demonstrates superior versatility and accuracy.
  • This method accommodates various weighting schemes and distributions.

Conclusions:

  • The resampling contingency procedure is recommended for calculating weighted kappa probability with multiple raters.
  • This method offers flexibility in weighting schemes and distributional assumptions.
  • It is particularly effective when the number of raters is manageable.