Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Testing the equality of two dependent kappa statistics.

A Donner1, M M Shoukri, N Klar

  • 1Department of Epidemiology and Biostatistics, The University of Western Ontario, London, Ontario, N6A 5C1, Canada.

Statistics in Medicine
|January 29, 2000
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Self-Diffusion in Amorphous Silicon by Local Bond Rearrangements.

Physical review letters·2018
Same author

Bortezomib, C1-inhibitor and plasma exchange do not prolong the survival of multi-transgenic GalT-KO pig kidney xenografts in baboons.

American journal of transplantation : official journal of the American Society of Transplantation and the American Society of Transplant Surgeons·2015
Same author

Regional variation in organ donation in Saudi Arabia.

Transplantation proceedings·2014
Same author

Propensity scores used for analysis of cluster randomized trials with selection bias: a simulation study.

Statistics in medicine·2013
Same author

An evaluation of utility measurement in Crohn's disease.

Inflammatory bowel diseases·2013
Same author

[Endoscopic calcaneoplasty (ECP) in Haglund's syndrome. Indication, surgical technique, surgical findings and results].

Zeitschrift fur Orthopadie und Unfallchirurgie·2011

New methods for comparing dependent kappa statistics (κ) help assess agreement between two raters with dichotomous outcomes. Adjusting for sample dependency is beneficial when correlations are similar across settings, recommending a specific goodness-of-fit approach.

Area of Science:

  • Statistics
  • Biostatistics
  • Psychometrics

Background:

  • Comparing agreement levels is crucial in research involving multiple ratings.
  • Dependent kappa statistics (κ) arise when subjects are rated under different conditions.
  • Existing methods often assume independent samples, limiting their application.

Purpose of the Study:

  • To develop and compare procedures for testing the equality of two dependent kappa statistics (κ).
  • To address scenarios with two raters and dichotomous outcomes, common in repeated measures or varied settings.
  • To evaluate the performance of these procedures via simulation.

Main Methods:

  • Developed extensions of existing methods for independent samples.
  • Employed Monte Carlo simulations to compare the accuracy and power of different procedures.

Related Experiment Videos

  • Focused on scenarios with dichotomous outcomes and two raters.

    • Main Results:

    • Adjusting for sample dependency is effective when between-setting correlations are similar to within-setting correlations.
    • Simulation results indicate when specific adjustments provide significant benefits.
    • Identified conditions where standard methods may be less reliable.

    Conclusions:

    • A goodness-of-fit procedure accounting for sample dependency is recommended under specific correlation conditions.
    • The choice of procedure depends on the magnitude of correlations within and between rating settings.
    • These findings offer guidance for accurately comparing agreement in dependent data structures.