Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Components-of-variance models and multiple-bootstrap experiments: an alternative method for random-effects, receiver

S V Beiden1, R F Wagner, G Campbell

  • 1Office of Science and Technology, Center for Devices and Radiological Health, U.S. Food and Drug Administration, Rockville, MD 20857, USA.

Academic Radiology
|May 10, 2000
PubMed
Summary

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Advancing bone health evaluation in Hermann's tortoises (<i>Testudo hermanni</i>) using spectral detector computed tomography.

Frontiers in veterinary science·2026
Same author

Optimized 3D brachial plexus MR neurography using deep learning reconstruction.

Skeletal radiology·2023
Same author

Canadian Surgery Forum.

Canadian journal of surgery. Journal canadien de chirurgie·2022
Same author

Abstracts of presentations to the Annual Meetings of the Canadian Association of General Surgeons Canadian Association of Thoracic Surgeons Canadian Hepato-Pancreato-Biliary Society Canadian Society of Surgical Oncology Canadian Society of Colon and Rectal Surgeons: Victoria, BC Sept. 10-13, 2009.

Canadian journal of surgery. Journal canadien de chirurgie·2022
Same author

Trends and characteristics in barbiturate deaths Australia 2000-2019: a national retrospective study.

Clinical toxicology (Philadelphia, Pa.)·2020
Same author

The reduction of abnormal behaviors in individually housed rhesus monkeys (Macaca mulatta) with a foraging/grooming board.

American journal of primatology·2020

This study introduces a novel multiple-bootstrap method for receiver operating characteristic (ROC) analysis, offering improved variance structure estimation compared to the Dorfman, Berbaum, and Metz (DBM) approach for diagnostic modalities.

Area of Science:

  • Medical Imaging and Diagnostics
  • Statistical Modeling
  • Biostatistics

Background:

  • Receiver operating characteristic (ROC) analysis is crucial for evaluating diagnostic test performance.
  • Existing methods like the Dorfman, Berbaum, and Metz (DBM) approach have limitations in capturing full variance structure.
  • Components-of-variance models offer a framework for deeper analysis.

Purpose of the Study:

  • To develop an alternative to random-effects ROC analysis using components-of-variance models.
  • To create a higher-order generalization of the DBM approach.
  • To provide enhanced information on the variance structure in ROC analysis.

Main Methods:

  • Developed a multiple-bootstrap technique as an alternative to population experiments for estimating variance components.

Related Experiment Videos

  • Utilized Monte Carlo simulations to compare bootstrap estimates with DBM and population results.
  • Estimated confidence intervals for ROC parameters to compare diagnostic modalities.
  • Main Results:

    • The bootstrap method demonstrated excellent agreement with population variance structures.
    • Confidence intervals for ROC area differences were comparable to or tighter than the DBM method, especially with high reader variability.
    • The new approach provided estimates of variance structures not available with DBM.

    Conclusions:

    • The multiple-bootstrap method offers a more general, nonparametric, maximum-likelihood approach to ROC analysis.
    • This technique overcomes the limitations of the DBM method's linear approximation.
    • The study successfully yielded previously unavailable estimates of variance structure.