Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Bias, prevalence and kappa

T Byrt1, J Bishop, J B Carlin

  • 1Clinical Epidemiology and Biostatistics Unit, Royal Children's Hospital Research Foundation, Parkville, Victoria, Australia.

Journal of Clinical Epidemiology
|May 1, 1993
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Black Hole Spectroscopy and Tests of General Relativity with GW250114.

Physical review letters·2026
Same author

GW250114: Testing Hawking's Area Law and the Kerr Nature of Black Holes.

Physical review letters·2025
Same author

Reducing noise associated with restraint box operation can facilitate animal handling in cattle abattoirs.

New Zealand veterinary journal·2025
Same author

Corrigendum to "A comparison of the efficacy of trastuzumab deruxtecan in advanced HER2-positive breast cancer: active brain metastasis versus progressive extracranial disease alone": [ESMO Open 8 (2023) 102033].

ESMO open·2024
Same author

A comparison of the efficacy of trastuzumab deruxtecan in advanced HER2-positive breast cancer: active brain metastasis versus progressive extracranial disease alone.

ESMO open·2023
Same author

Sample size determination for external pilot cluster randomised trials with binary feasibility outcomes: a tutorial.

Pilot and feasibility studies·2023
Same journal

Harms Reporting Was Frequently Incomplete or Discordant in Biomedical Randomized Trials Published in 2023: A Meta-epidemiological Study.

Journal of clinical epidemiology·2026
Same journal

Using an Open Science Checklist in Grant Proposal Reviews to Predict Reproducibility of Funded Publications.

Journal of clinical epidemiology·2026
Same journal

A comparison of five statistical methods used to analyse longitudinal EORTC QLQ-C30 quality of life scores in randomised controlled trials: a simulation study.

Journal of clinical epidemiology·2026
Same journal

Sample Size Determination for Decision-centered Pragmatic Trials.

Journal of clinical epidemiology·2026
Same journal

Many multicenter randomized controlled trials do not account for center effect: a methodological review.

Journal of clinical epidemiology·2026
Same journal

Patient Acceptability of the Modified Zelen Approach to Randomized Trials - A Survey of the CAPS THA Cohort.

Journal of clinical epidemiology·2026
See all related articles

Cohen's kappa, a measure of inter-rater agreement, can be misleading due to bias and prevalence. New indices independently measure bias and prevalence, offering a clearer interpretation of agreement studies.

Area of Science:

  • Statistics
  • Biostatistics
  • Psychometrics

Background:

  • Cohen's kappa is widely used to assess agreement between two raters.
  • Interpretation of kappa is complicated by observer bias and data prevalence.
  • Previous studies have highlighted paradoxes in kappa's application.

Purpose of the Study:

  • To address the limitations of Cohen's kappa.
  • To develop new indices for measuring agreement, bias, and prevalence independently.
  • To provide a formula relating kappa to these new indices.

Main Methods:

  • Defined new indices for observed agreement, bias, and prevalence.
  • Derived a formula expressing kappa using these three independent indices.
  • Analyzed the relationship between kappa, bias, and prevalence.

Related Experiment Videos

Main Results:

  • New indices provide independent quantification of agreement, bias, and prevalence.
  • A simple formula links kappa to these three components.
  • Kappa values alone can be misleading in agreement studies.

Conclusions:

  • Cohen's kappa interpretation is influenced by bias and prevalence.
  • Researchers should report bias and prevalence alongside kappa.
  • New indices offer a more comprehensive assessment of inter-rater reliability.