Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Weighted Mean00:57

Weighted Mean

While taking the arithmetic, geometric, or harmonic mean of a sample data set, equal importance is assigned to all the data points. However, all the values may not always be equally important in some data sets. An intrinsic bias might make it more important to give more weightage to specific values over others.
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
Kendall's Coefficient of Concordance01:20

Kendall's Coefficient of Concordance

Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects or...
Expected Frequencies in Goodness-of-Fit Tests01:19

Expected Frequencies in Goodness-of-Fit Tests

A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
Kendall's Tau Test01:16

Kendall's Tau Test

Kendall's tau test, also known as the Kendall rank coefficient test, is a nonparametric method for assessing association between two variables. This test is particularly useful for identifying significant correlations when the distributions of the sample and population are unknown. Developed in 1938 by the British statistician Sir Maurice George Kendall, the tau coefficient (denoted as τ) serves as a rank correlation coefficient, with values ranging from -1 to +1.
A τ value of +1 indicates that...
Poisson Probability Distribution01:09

Poisson Probability Distribution

A Poisson probability distribution is a discrete probability distribution. It gives the probability of a number of events occurring in a fixed interval of time or space if these events happen at a known average rate and independently of the time since the last event. For example, a book editor might be interested in the number of words spelled incorrectly in a particular book. It might be that, on average, there are five words spelled incorrectly in 100 pages. The interval is 100 pages.
The...
Chebyshev's Theorem to Interpret Standard Deviation01:15

Chebyshev's Theorem to Interpret Standard Deviation

Chebyshev’s theorem, also known as Chebyshev’s Inequality, states that the proportion of values of a dataset for K standard deviation is calculated using the equation:

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Spatial-temporal association of soil Pb and children's blood Pb in the Detroit Tri-County Area of Michigan (USA).

Environmental research·2020
Same author

The concurrent decline of soil lead and children's blood lead in New Orleans.

Proceedings of the National Academy of Sciences of the United States of America·2019
Same author

Spatiotemporal exposome dynamics of soil lead and children's blood lead pre- and ten years post-Hurricane Katrina: Lead and other metals on public and private properties in the city of New Orleans, Louisiana, U.S.A.

Environmental research·2017
Same author

Spatiotemporal dynamic transformations of soil lead and children's blood lead ten years after Hurricane Katrina: New grounds for primary prevention.

Environment international·2016
Same author

Evolving from reactive to proactive medicine: community lead (Pb) and clinical disparities in pre- and post-Katrina New Orleans.

International journal of environmental research and public health·2014
Same author

Environmental and health disparities in residential communities of New Orleans: the need for soil lead intervention to advance primary prevention.

Environment international·2012
Same journal

Continued Influence Effect: A Three-Dimensional Framework Shaping Practical and Theoretical Perspectives.

Psychological reports·2026
Same journal

ADHD Symptoms, Interpersonal Functioning, and Sexual Orientation in Undergraduate Adults.

Psychological reports·2026
Same journal

Emotion Regulation, Impulsivity, and Cluster B Personality Disorders.

Psychological reports·2026
Same journal

Physical Activity and Social Anxiety in Highly Sensitive Individuals: The Mediating Role of Cognitive Reappraisal.

Psychological reports·2026
Same journal

Development and Psychometric Evaluation of the Children's Prosocial Behaviors in a Preschool Setting (CPBPS).

Psychological reports·2026
Same journal

"Advances in Public & Social Psychology" Special Session of WPMH2026.

Psychological reports·2026
See all related articles

Related Experiment Video

Updated: Jun 26, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

Resampling permutation probability values for weighted kappa.

Janis E Johnston1, Kenneth J Berry, Paul W Mielke

  • 1U.S. EPA National Homeland Security Research Center, USA.

Psychological Reports
|December 24, 2008
PubMed
Summary
This summary is machine-generated.

A new resampling method and FORTRAN program (RWK) are introduced for weighted kappa analysis. This tool calculates the weighted kappa statistic and its statistical significance for improved agreement assessment.

More Related Videos

Inverse Probability of Treatment Weighting (Propensity Score) using the Military Health System Data Repository and National Death Index
06:55

Inverse Probability of Treatment Weighting (Propensity Score) using the Military Health System Data Repository and National Death Index

Published on: January 8, 2020

Related Experiment Videos

Last Updated: Jun 26, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

Inverse Probability of Treatment Weighting (Propensity Score) using the Military Health System Data Repository and National Death Index
06:55

Inverse Probability of Treatment Weighting (Propensity Score) using the Military Health System Data Repository and National Death Index

Published on: January 8, 2020

Area of Science:

  • Statistics
  • Biostatistics
  • Psychometrics

Background:

  • Weighted kappa is a common metric for inter-rater reliability.
  • Traditional methods for assessing weighted kappa significance can be limited.

Purpose of the Study:

  • To introduce a novel permutation algorithm for resampling weighted kappa.
  • To provide a FORTRAN program (RWK) for practical implementation.

Main Methods:

  • A permutation algorithm was developed for resampling weighted kappa.
  • The FORTRAN program RWK was created to execute the algorithm.

Main Results:

  • The RWK program computes the weighted kappa test statistic.
  • It also determines the resampling one-sided upper-tail probability value.

Conclusions:

  • The provided algorithm and program offer a robust method for weighted kappa significance testing.
  • This facilitates more accurate assessment of inter-rater agreement in various fields.