Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Inference procedures for assessing interobserver agreement among multiple raters.

M Altaye1, A Donner, N Klar

  • 1Center for Pediatric Research, Children's Hospital of the King's Daughters, Eastern Virginia Medical School, Norfolk 23510, USA. altayem@chkd.com

Biometrics
|June 21, 2001
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Psychometric properties of inhibitory control measures among youth with Down syndrome.

Journal of intellectual disability research : JIDR·2023
Same author

The Construction of a Predictive Composite Index for Decision-Making of CSF Diversion Surgery in Pediatric Patients following Prenatal Myelomeningocele Repair.

AJNR. American journal of neuroradiology·2022
Same author

Network-based Responses to the Psychomotor Vigilance Task during Lapses in Adolescents after Short and Extended Sleep.

Scientific reports·2019
Same author

Nephrotoxic Medications and Associated Acute Kidney Injury in Very Low Birth Weight Infants.

Journal of clinical nephrology and research·2019
Same author

Self-Diffusion in Amorphous Silicon by Local Bond Rearrangements.

Physical review letters·2018
Same author

Bortezomib, C1-inhibitor and plasma exchange do not prolong the survival of multi-transgenic GalT-KO pig kidney xenografts in baboons.

American journal of transplantation : official journal of the American Society of Transplantation and the American Society of Transplant Surgeons·2015
Same journal

Fast penalized generalized estimating equations for large longitudinal functional datasets.

Biometrics·2026
Same journal

Causally-interpretable random-effects meta-analysis.

Biometrics·2026
Same journal

Statistical inference for mean function of partially observed functional time series.

Biometrics·2026
Same journal

Subgroup identification via Interaction Tree and Mixed Model for Repeated Measures with application to Alzheimer's disease.

Biometrics·2026
Same journal

Finite mixtures of linear quantile regressions with concomitant variables: a solution to endogeneity in longitudinal data modeling.

Biometrics·2026
Same journal

A Bayesian phase I/II platform design with data augmentation accounting for delayed outcomes.

Biometrics·2026
See all related articles

This study introduces a new statistical method for assessing interobserver agreement with multiple raters and binary outcomes. The procedure ensures accurate confidence intervals and provides a sample-size formula for study planning.

Area of Science:

  • Statistics
  • Biostatistics
  • Medical Research Methodology

Background:

  • Interobserver agreement is crucial for reliable data in studies with multiple raters.
  • Existing methods are often limited to two raters or specific statistical models.
  • Accurate assessment of agreement is vital for study validity and reproducibility.

Purpose of the Study:

  • To develop a novel statistical procedure for constructing inferences on interobserver agreement.
  • To extend existing goodness-of-fit procedures to accommodate multiple raters and binary outcomes.
  • To provide a practical tool for sample size determination in such studies.

Main Methods:

  • The proposed procedure utilizes a chi-square goodness-of-fit test applied to the correlated binomial model.

Related Experiment Videos

  • It extends the Donner and Eliasziw (1992) goodness-of-fit procedure for two raters.
  • The method is evaluated for its confidence-interval coverage levels across various parameter combinations.

    • Main Results:

    • The new procedure demonstrates confidence-interval coverage levels close to the nominal level.
    • It performs well across a wide range of parameter combinations.
    • A validated sample-size formula is derived for planning studies.

    Conclusions:

    • The proposed method offers a robust approach for inferring interobserver agreement with multiple raters and binary outcomes.
    • It enhances statistical rigor in studies involving subjective assessments.
    • The sample-size formula aids researchers in designing efficient studies.