Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Assessing observer agreement in studies involving replicated binary observations.

Michael Haber1, Jingjing Gao, Huiman X Barnhart

  • 1Department of Biostatistics, Rollins School of Public Health, Emory University, Atlanta, Georgia 30322, USA. mhaber@sph.emory.edu

Journal of Biopharmaceutical Statistics
|July 7, 2007
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Dietary Periplaneta americana chitin maintains inflammatory homeostasis and enhances innate immunity in juvenile common carp (Cyprinus carpio) via the Nrf2/NF-κB network.

Fish & shellfish immunology·2026
Same author

Atlantoaxial subluxation treated with exercise therapy combined with occipito-maxillary band traction: a case report.

Journal of medical case reports·2026
Same author

Self-adaptive hetero-phase superlattices in TaS<sub>2</sub> via layer-resolved 1T-to-1H transformations.

National science review·2026
Same author

Systematic Engineering of Intra-Articular Drug Release Profiles Reveals a Key Determinant of Disease-Modifying Efficacy in Post-Traumatic Osteoarthritis.

bioRxiv : the preprint server for biology·2026
Same author

Corrigendum to "Integrated multiplex PCR and metatranscriptomics reveal upper-lower airway microbial landscapes in pediatric respiratory infections" [Virol. Sin. 41 (2026) 58-69].

Virologica Sinica·2026
Same author

Patterns and predictors of anxiety medication use among United States adults: a national analysis with a focus on racial disparities in the Asian population.

Frontiers in public health·2026
Same journal

Correction.

Journal of biopharmaceutical statistics·2026
Same journal

Leveraging external controls in clinical trials: estimands, estimation, assumptions.

Journal of biopharmaceutical statistics·2026
Same journal

Special issue of nonclinical statistics in regulatory applications guest editors' notes.

Journal of biopharmaceutical statistics·2026
Same journal

Comparison of flexible parametric modeling and nonparametric methods to estimate restricted mean survival time: A simulation study.

Journal of biopharmaceutical statistics·2026
Same journal

Simulated treatment comparisons with jackknife pseudo values for estimating population-adjusted marginal treatment effects.

Journal of biopharmaceutical statistics·2026
Same journal

Sample sizes for randomized controlled trials utilizing Bayesian response adaptive randomization for continuous outcomes.

Journal of biopharmaceutical statistics·2026
See all related articles

This study introduces a novel method for assessing observer agreement in binary assessments. It compares inter-observer discordance to intra-observer discordance for reliable measurement evaluation.

Area of Science:

  • Biostatistics
  • Medical Informatics
  • Diagnostic Accuracy

Background:

  • Evaluating agreement between observers is crucial for diagnostic reliability.
  • Existing methods may not adequately account for intra-observer variability.

Purpose of the Study:

  • To propose a new approach for evaluating agreement between two observers using binary observations.
  • To compare inter-observer disagreement with intra-observer disagreement.

Main Methods:

  • Developed a novel agreement evaluation approach comparing observer disagreement to replicated observation disagreement.
  • Utilized a nonparametric method for estimating agreement coefficients with replicated readings.
  • Employed a simulation study to assess the reliability of the estimation method.

Related Experiment Videos

Main Results:

  • The proposed method provides a framework for assessing agreement in two distinct situations: symmetric observer agreement and agreement with an imperfect gold standard.
  • Simulation results demonstrated the reliability of the nonparametric estimation method.

Conclusions:

  • The new approach offers a robust method for quantifying observer agreement, particularly when accounting for replicated observations.
  • This method enhances the evaluation of diagnostic accuracy and observer reliability in binary assessments.