Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Power estimation for the Dorfman-Berbaum-Metz method.

Stephen L Hillis1, Kevin S Berbaum

  • 1Center for Research in the Implementation of Innovative Strategies in Practice (CRIISP), Iowa City VA Medical Center, Iowa, USA. steve-hillis@uiowa.edu

Academic Radiology
|November 25, 2004
PubMed
Summary

This study details power and sample size calculations for multireader ROC studies using the Dorfman-Berbaum-Metz method. It provides a straightforward procedure for planning future studies with pilot data to ensure adequate statistical power.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Relationship of opioid tolerance to patient and wound factors, and wound micro-environment in patients with open wounds.

Journal of wound care·2025
Same author

An alternative parameterization for the binormal ROC curve, with applications to sizing and simulation studies.

Proceedings of SPIE--the International Society for Optical Engineering·2024
Same author

The heterogeneous wound microbiome varies with wound care pain, dressing type, and inflammatory gene expression.

Wound repair and regeneration : official publication of the Wound Healing Society [and] the European Tissue Repair Society·2024
Same author

Obuchowski-Rockette analysis for multi-reader multi-case (MRMC) readers-nested-in-test study design with unequal numbers of readers.

Proceedings of SPIE--the International Society for Optical Engineering·2023
Same author

Relationship between Obuchowski-Rockette-Hillis and Gallas methods for analyzing multi-reader diagnostic imaging data with empirical AUC as the reader performance measure.

Biostatistics & epidemiology·2023
Same author

Roe and Metz identical-test simulation model for validating multi-reader methods of analysis for comparing different radiologic imaging modalities.

Journal of medical imaging (Bellingham, Wash.)·2023

Area of Science:

  • Medical statistics
  • Diagnostic accuracy research
  • Receiver Operating Characteristic (ROC) analysis

Background:

  • Multireader Receiver Operating Characteristic (ROC) studies are crucial for evaluating diagnostic test performance.
  • Accurate power and sample size calculations are essential for designing robust ROC studies.
  • The Dorfman-Berbaum-Metz (DBM) method is a standard approach for analyzing such studies.

Purpose of the Study:

  • To describe a method for power and sample size computations for the DBM method in multireader ROC studies.
  • To utilize pilot or prior study data for planning future ROC study sample sizes.
  • To ensure sufficient statistical power for detecting meaningful differences in diagnostic accuracy.

Main Methods:

  • A step-by-step procedure for power and sample size computations is presented.

Related Experiment Videos

  • Two studies with non-significant modality differences were used as pilot data.
  • Calculations focus on the mean of treatment-reader Area Under the Curve (AUC) estimates.

    • Main Results:

    • The described method allows estimation of reader and case sample sizes for future studies.
    • The goal is to achieve 80% power to detect specified differences in modality AUCs.
    • Illustrative examples using pilot studies are provided.

    Conclusions:

    • The power and sample size computation procedure for the DBM method is practical and easy to apply.
    • Multiple reader and case sample size combinations can achieve desired statistical power for a given effect size.
    • Comparability of pilot/previous study data (modalities, reader expertise, case selection) to the planned study is critical for accurate computations.