Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Search research articles

Related Experiment Videos

Identical-test Roe and Metz simulation model for validating multi-reader methods of analysis for comparing different

Stephen L Hillis¹

¹Departments of Radiology and Biostatistics, University of Iowa, Iowa City, IA, USA.

Proceedings of Spie--The International Society for Optical Engineering

|September 26, 2022

Summary

Related Concept Videos

Imaging Studies for Cardiovascular System III: X-Ray

Imaging Studies for Cardiovascular System III: X-Ray

The most common cardiovascular diagnostic test is an X-ray. It produces images of the heart, blood vessels, and adjacent structures.
Definition and Purpose
An X-ray, or radiograph, is a non-invasive method that uses ionizing radiation to take images of internal structures. It is mainly used in cardiac imaging to examine the heart, lungs, and major blood vessels, aiming to identify abnormalities in the heart's size, shape, and position, such as heart failure, congenital defects, and vascular...

Imaging Studies II: Positron Emission Tomography and Scintigraphy

Imaging Studies II: Positron Emission Tomography and Scintigraphy

Positron Emission Tomography (PET) is a medical imaging technique that provides crucial insights into the body's physiological functions at a molecular level. It is an indispensable resource for diagnosing, staging, and monitoring various illnesses, notably cancer, neurological disorders, and cardiovascular conditions.
Fundamental Principles of PET

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Relationship of opioid tolerance to patient and wound factors, and wound micro-environment in patients with open wounds.

Journal of wound care·2025

Same author

An alternative parameterization for the binormal ROC curve, with applications to sizing and simulation studies.

Proceedings of SPIE--the International Society for Optical Engineering·2024

Same author

The heterogeneous wound microbiome varies with wound care pain, dressing type, and inflammatory gene expression.

Wound repair and regeneration : official publication of the Wound Healing Society [and] the European Tissue Repair Society·2024

Same author

Obuchowski-Rockette analysis for multi-reader multi-case (MRMC) readers-nested-in-test study design with unequal numbers of readers.

Proceedings of SPIE--the International Society for Optical Engineering·2023

Same author

Relationship between Obuchowski-Rockette-Hillis and Gallas methods for analyzing multi-reader diagnostic imaging data with empirical AUC as the reader performance measure.

Biostatistics & epidemiology·2023

Same author

Roe and Metz identical-test simulation model for validating multi-reader methods of analysis for comparing different radiologic imaging modalities.

Journal of medical imaging (Bellingham, Wash.)·2023

This study introduces an "identical-test" null model for multireader multicase (MRMC) data, crucial for accurate diagnostic imaging analysis. Simulations demonstrate its importance in preventing negative variance estimates in Obuchowski-Rockette models.

Area of Science:

Medical Imaging
Biostatistics
Diagnostic Accuracy Research

Background:

The Roe and Metz model and its generalizations are standard for simulating multireader multicase (MRMC) data in diagnostic imaging.
Existing "null" models for evaluating type I error in MRMC analysis do not ensure tests are identical, potentially introducing bias.
Previous research has not addressed the formulation of an "identical-test" null model.

Purpose of the Study:

To introduce and explain the formulation of an "identical-test" null model for MRMC data.
To highlight the significance of this identical-test model in diagnostic accuracy studies.
To empirically demonstrate the necessity of Obuchowski-Rockette model constraints using simulations.

Main Methods:

Development of an "identical-test" null model for MRMC data simulation.

Keywords:

Diagnostic radiology MRMC Obuchowski and Rockette ROC curve Roe and Metz Type I error multi-reader multi-case analysis

Related Experiment Videos

Comparison of the proposed identical-test model with existing null models.

Conducting simulations to evaluate model performance and variance estimation.

Main Results:

The proposed identical-test model ensures all aspects of the tests are equivalent under the null hypothesis.
Simulations confirmed the importance of Obuchowski-Rockette model constraints.
Negative variance estimates were observed without proper constraints, a finding empirically demonstrated here.

Conclusions:

The identical-test null model is essential for robust evaluation of diagnostic imaging tests.
Proper application of Obuchowski-Rockette model constraints is critical to avoid erroneous results.
This work provides a more rigorous framework for MRMC analysis and sample size determination.