Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Exact permutation probability values for weighted kappa.

Kenneth J Berry1, Janis E Johnston, Paul W Mielke

  • 1Department of Sociology, Colorado State University, Fort Collins, CO 80523-1784, USA. berry@mail.colostate.edu

Psychological Reports
|May 17, 2008
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Spatial-temporal association of soil Pb and children's blood Pb in the Detroit Tri-County Area of Michigan (USA).

Environmental research·2020
Same author

The concurrent decline of soil lead and children's blood lead in New Orleans.

Proceedings of the National Academy of Sciences of the United States of America·2019
Same author

Spatiotemporal exposome dynamics of soil lead and children's blood lead pre- and ten years post-Hurricane Katrina: Lead and other metals on public and private properties in the city of New Orleans, Louisiana, U.S.A.

Environmental research·2017
Same author

Spatiotemporal dynamic transformations of soil lead and children's blood lead ten years after Hurricane Katrina: New grounds for primary prevention.

Environment international·2016
Same author

Evolving from reactive to proactive medicine: community lead (Pb) and clinical disparities in pre- and post-Katrina New Orleans.

International journal of environmental research and public health·2014
Same author

Environmental and health disparities in residential communities of New Orleans: the need for soil lead intervention to advance primary prevention.

Environment international·2012
Same journal

Continued Influence Effect: A Three-Dimensional Framework Shaping Practical and Theoretical Perspectives.

Psychological reports·2026
Same journal

ADHD Symptoms, Interpersonal Functioning, and Sexual Orientation in Undergraduate Adults.

Psychological reports·2026
Same journal

Emotion Regulation, Impulsivity, and Cluster B Personality Disorders.

Psychological reports·2026
Same journal

Physical Activity and Social Anxiety in Highly Sensitive Individuals: The Mediating Role of Cognitive Reappraisal.

Psychological reports·2026
Same journal

Development and Psychometric Evaluation of the Children's Prosocial Behaviors in a Preschool Setting (CPBPS).

Psychological reports·2026
Same journal

"Advances in Public & Social Psychology" Special Session of WPMH2026.

Psychological reports·2026
See all related articles

A new permutation algorithm and FORTRAN program are available for weighted kappa analysis. This tool calculates the weighted kappa statistic and exact p-values for statistical significance.

Area of Science:

  • Statistics
  • Biostatistics
  • Computational Statistics

Background:

  • Weighted kappa is a crucial metric for assessing inter-rater reliability, particularly in fields with ordinal or non-uniform agreement scales.
  • Accurate statistical testing for weighted kappa is essential for validating agreement beyond chance.

Purpose of the Study:

  • To introduce a novel permutation algorithm for calculating weighted kappa.
  • To provide a user-friendly FORTRAN program (EWK) for implementing this algorithm.
  • To enable the computation of both the weighted kappa test statistic and its exact probability values.

Main Methods:

  • Development of a permutation algorithm specifically designed for weighted kappa.
  • Implementation of the algorithm into a FORTRAN program named EWK.

Related Experiment Videos

  • Utilizing the EWK program to compute the weighted kappa test statistic and exact one-sided upper-tail probability values.

    • Main Results:

    • The FORTRAN program EWK successfully computes the weighted kappa test statistic.
    • The program accurately determines the exact one-sided upper-tail probability values for weighted kappa.
    • The permutation algorithm provides a robust method for assessing the statistical significance of weighted kappa.

    Conclusions:

    • The provided permutation algorithm and EWK program offer a valuable tool for researchers needing to assess inter-rater reliability with weighted kappa.
    • This facilitates more rigorous statistical analysis of agreement in various scientific disciplines.
    • The availability of exact probability values enhances the interpretability and reliability of weighted kappa results.