Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Understanding interobserver agreement: the kappa statistic.

Anthony J Viera1, Joanne M Garrett

  • 1Robert Wood Johnson Clinical Scholars Program, University of North Carolina, USA. anthony_viera@med.unc.edu

Family Medicine
|May 11, 2005
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Oral microbiome alpha diversity and all-cause, cardiovascular, and non-cardiovascular mortality in US adults: Evidence from the NHANES 2009-2019.

Atherosclerosis·2024
Same author

Use of Impedance Cardiography to Guide Blood Pressure Lowering Medication Selection: Systematic Review of Randomized Controlled Trials.

American journal of hypertension·2024
Same author

The utility of home blood pressure load in predicting average self-measured blood pressure.

Journal of hypertension·2024
Same author

Who chooses "healthy" meals? An analysis of lunchtime meal quality in a workplace cafeteria.

BMC public health·2024
Same author

The eProvider Model: A Novel Approach to the Modern Problem of Portal Message Overload.

Family practice management·2024
Same author

Sex Differences in Receipt of Bystander Cardiopulmonary Resuscitation Considering Neighborhood Racial and Ethnic Composition.

Journal of the American Heart Association·2024

The kappa statistic measures inter-rater reliability for diagnostic tests, accounting for chance agreement. While widely used, its accuracy can be influenced by the prevalence of findings.

Area of Science:

  • Medical statistics
  • Observer agreement studies
  • Diagnostic test evaluation

Background:

  • Subjective interpretation is common in medical assessments like physical exams and radiographic readings.
  • Evaluating agreement between observers requires statistical methods that correct for chance agreement.
  • The kappa statistic is a standard measure for inter-rater reliability.

Purpose of the Study:

  • To highlight the importance of using appropriate statistics for observer agreement.
  • To introduce the kappa statistic as a common measure for inter-rater reliability.
  • To acknowledge and address limitations of the kappa statistic.

Main Methods:

  • Discussing the application of statistical measures in observational studies.
  • Defining the kappa statistic and its interpretation (0=chance, 1=perfect agreement).

Related Experiment Videos

  • Identifying the influence of prevalence on kappa values.

    • Main Results:

    • Kappa statistic is the prevalent method for assessing observer agreement.
    • Kappa values range from 0 (chance agreement) to 1 (perfect agreement).
    • The prevalence of the observed condition can affect kappa statistic results.

    Conclusions:

    • Studies assessing observer agreement should incorporate chance-corrected statistics like kappa.
    • Understanding the limitations of the kappa statistic, particularly prevalence issues, is crucial.
    • Further methods exist to address the limitations associated with the kappa statistic.