Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Multireader multicase variance analysis for binary data.

Brandon D Gallas1, Gene A Pennello, Kyle J Myers

  • 1National Institute of Biomedical Imaging and Bioengineering/Center for Derices and Radiological Health, US Food and Drug Administration, Silver Spring, Maryland 20993, USA. brandon.gallas@fda.hhs.gov

Journal of the Optical Society of America. A, Optics, Image Science, and Vision
|December 7, 2007
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Methodological considerations for evaluating deep learning segmentation models in digital pathology whole-slide images.

Journal of medical imaging (Bellingham, Wash.)·2026
Same author

Task-Based Sampling of Patient Data for Rigorous Machine Learning/AI Performance Assessment.

Journal of imaging informatics in medicine·2026
Same author

Artificial intelligence-assisted multiscale lung modeling to predict alveolar septal wall stress.

Acta biomaterialia·2025
Same author

Machine learning evaluation of pneumonia severity: subgroup performance in the Medical Imaging and Data Resource Center modified radiographic assessment of lung edema mastermind challenge.

Journal of medical imaging (Bellingham, Wash.)·2025
Same author

Physics-Informed In-Silico Dynamic Computed Tomography of Human Lungs: Generation, Evaluation, and Refinement.

Journal of biomechanical engineering·2025
Same author

Complete spatiotemporal quantification of cardiac motion in mice through multi-view magnetic resonance imaging and super-resolution reconstruction.

Scientific reports·2025
Same journal

Multi-module collaborative optimization-driven fast speckle correlation imaging in variable environments.

Journal of the Optical Society of America. A, Optics, image science, and vision·2026
Same journal

Secrecy performance analysis of NOMA-UWOC systems over a vertically stratified WGG oceanic turbulence channel.

Journal of the Optical Society of America. A, Optics, image science, and vision·2026
Same journal

Backscattering of plane waves in a composite system containing a rough surface and anisotropic scatterers.

Journal of the Optical Society of America. A, Optics, image science, and vision·2026
Same journal

Aspherical surface construction methods based on extended Jacobi polynomials.

Journal of the Optical Society of America. A, Optics, image science, and vision·2026
Same journal

OCT sidelobe suppression method based on dual-path phase sinusoidal modulation and minimum value fusion.

Journal of the Optical Society of America. A, Optics, image science, and vision·2026
Same journal

Optical design concepts using wavelength-selective diffractive optics to enable miniaturized multimodal endoscopic imaging across separated spectral ranges.

Journal of the Optical Society of America. A, Optics, image science, and vision·2026
See all related articles

This study extends multireader multicase (MRMC) variance analysis for ROC curve data to binary outcomes and incomplete reader case designs. Unbiased variance estimates are compared to naive estimates across various study parameters.

Area of Science:

  • Medical imaging analysis
  • Statistical modeling
  • Observer performance studies

Background:

  • Multireader multicase (MRMC) variance analysis is standard for evaluating reader performance using the area under the ROC curve (AUC).
  • Existing methods often assume complete data where every reader analyzes every case.
  • Adaptation to binary data and more flexible study designs is needed.

Purpose of the Study:

  • To extend MRMC variance analysis to binary data.
  • To accommodate generic study designs where readers may not interpret all cases.
  • To provide robust variance estimation for observer performance studies.

Main Methods:

  • Developed an extension of MRMC variance analysis applicable to binary outcomes.
  • Incorporated methods to handle incomplete reader-case data.

Related Experiment Videos

  • Utilized fundamental moments from AUC analysis for variance estimation.
  • Conducted simulations to compare new unbiased estimates with traditional naive estimates.

    • Main Results:

    • The extended MRMC analysis provides unbiased variance estimates for binary data and incomplete designs.
    • Simulations demonstrate the accuracy of the proposed method across diverse study parameters.
    • The required subset of fundamental moments was identified for the extended analysis.

    Conclusions:

    • The developed MRMC variance analysis framework is suitable for binary data and complex observer study designs.
    • This extension enhances the reliability of observer performance evaluation in medical research.
    • The findings support more flexible and accurate statistical analysis in reader studies.