Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Overall concordance correlation coefficient for evaluating agreement among multiple observers.

Huiman X Barnhart1, Michael Haber, Jingli Song

  • 1Department of Biostatistics, The Rollins School of Public Health of Emory University, 1518 Clifton Road NE, Atlanta, Georgia 30322, USA. hbarnha@sph.emory.edu

Biometrics
|December 24, 2002
PubMed
Summary

This study introduces the overall concordance correlation coefficient (OCCC) to measure agreement among multiple observers in studies. The OCCC provides a robust measure of interobserver variability for continuous variables.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Clinical and HLA Associations of Fluoroquinolone-Induced Liver Injury: Results From the Drug-Induced Liver Injury Network.

The American journal of gastroenterology·2025
Same author

Dual-Functional Silicon-Based Nanofluorescent Platform for Iron Detection and Capecitabine Delivery in Colorectal Cancer Treatment.

Journal of fluorescence·2025
Same author

Liver Injury due to Intravenous Methylprednisolone in the Drug-Induced Liver Injury Network.

Liver international : official journal of the International Association for the Study of the Liver·2025
Same author

Comparison of Measures of Pain Intensity During Sickle Cell Disease Vaso-Occlusive Episodes.

The journal of pain·2024
Same author

Magnetism and electronic properties of Co<sub>n</sub>MoP (n = 1 ~ 5) cluster: a DFT study.

Journal of molecular modeling·2024
Same author

A comparison of the effect of patient-specific versus weight-based protocols to treat vaso-occlusive episodes in the emergency department.

Academic emergency medicine : official journal of the Society for Academic Emergency Medicine·2023

Area of Science:

  • Biostatistics
  • Medical Statistics
  • Quantitative Research Methods

Background:

  • Accurate measurement is crucial for study design.
  • The concordance correlation coefficient (CCC) measures agreement for continuous variables but is limited to two observers.
  • Assessing agreement among multiple observers is necessary for large-scale studies.

Purpose of the Study:

  • To present an overall CCC (OCCC) for assessing agreement among multiple fixed observers.
  • To define OCCC in terms of interobserver variability.
  • To evaluate the OCCC using generalized estimating equations (GEE) and U-statistics.

Main Methods:

  • The study introduces the overall CCC (OCCC) as a measure of agreement among multiple observers.
  • Inference for OCCC was evaluated using generalized estimating equations (GEE) and U-statistics.

Related Experiment Videos

  • Simulations were conducted to compare GEE and U-statistics for small samples.

    • Main Results:

    • The OCCC incorporates precision and accuracy indices.
    • OCCC is equivalent to the generalized CCC when using a squared distance function.
    • OCCC is intuitively defined by interobserver variability and is a weighted average of pairwise CCCs.

    Conclusions:

    • The OCCC offers a valuable tool for assessing agreement among multiple observers in scientific studies.
    • The study illustrates OCCC application using medical examples with GEE, U-statistics, and bootstrap methods.
    • The proposed methods provide reliable inference for OCCC, even with small sample sizes.