Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

A note on interrater agreement.

K F Hirji1, M H Rosove

  • 1Department of Epidemiology, Faculty of Medicine, University of Dar es Salaam, Tanzania.

Statistics in Medicine
|July 1, 1990
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Confirmation that ethanol potentiates aspirin-induced prolongation of the bleeding time.

Thrombosis research·2010
Same author

Tumor lysis syndrome occurring after the administration of rituximab in lymphoproliferative disorders: high-grade non-Hodgkin's lymphoma and chronic lymphocytic leukemia.

American journal of hematology·1999
Same author

Exact and asymptotic tests for homogeneity in several 2 x 2 tables.

Statistics in medicine·1999
Same author

Continuous infusional 5-fluorouracil chemotherapy.

Annals of surgery·1996
Same author

Persistently seronegative men from whom HIV-1 has been isolated are genetically and immunologically distinct.

Immunology letters·1996
Same author

Resistance to HIV infection may be genetically mediated.

AIDS (London, England)·1996
Same journal

A Causal Framework for Evaluating the Total Effect of Strategies Aiming to Expand Screening and to Improve Outcomes.

Statistics in medicine·2026
Same journal

Causal Effects on Nonterminal Event Time With Application to Antibiotic Usage and Future Resistance.

Statistics in medicine·2026
Same journal

Subgroup Analysis of Interval-censored Failure Time Data With Application to Alzheimer's Disease.

Statistics in medicine·2026
Same journal

Rejoinder to Commentaries on "A Perspective on the Appropriate Implementation of ICH E9(R1) Addendum Strategies for Handling Intercurrent Events".

Statistics in medicine·2026
Same journal

A Multi-Stage Drop-the-Loser Design With Superiority Boundaries.

Statistics in medicine·2026
Same journal

Interpretable ROI Identification in Brain Image Analysis: Overcoming CNN Black Box Challenges With Kriging-Enhanced Adaptive Sampling.

Statistics in medicine·2026
See all related articles

This study examines the Rogot and Goldberg measure for interrater agreement, offering a novel approach that accounts for chance, perfect agreement, and disagreement. It also enables category-specific analysis, even with missing data, and introduces a new inference method.

Area of Science:

  • Statistics
  • Biostatistics
  • Psychometrics

Background:

  • Interrater agreement is crucial for reliable data collection in various scientific fields.
  • Existing measures often fail to account for all sources of agreement and disagreement.
  • The Rogot and Goldberg measure offers a more comprehensive approach to assessing agreement.

Purpose of the Study:

  • To investigate the statistical properties of the Rogot and Goldberg measure of interrater agreement.
  • To highlight its advantages over commonly used agreement measures.
  • To introduce a novel asymptotic method for statistical inference with this measure.

Main Methods:

  • Analysis of the Rogot and Goldberg interrater agreement measure.
  • Development of an asymptotic method for statistical inference.

Related Experiment Videos

  • Application to scenarios with missing main diagonal data.

    • Main Results:

    • The Rogot and Goldberg measure uniquely standardizes for both perfect agreement and disagreement.
    • It allows for category-specific conditional agreement assessment, accommodating missing data.
    • An asymptotic inference method was successfully developed and validated.

    Conclusions:

    • The Rogot and Goldberg measure provides a robust and versatile tool for assessing interrater agreement.
    • Its ability to handle missing data and standardize for various agreement types enhances its utility.
    • The proposed inference method facilitates its practical application in research.