Related Experiment Video
Updated: Jul 5, 2026

13:44
Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns
Published on: August 30, 2013
Recent developments in the Dorfman-Berbaum-Metz procedure for multireader ROC study analysis.
Stephen L Hillis1, Kevin S Berbaum, Charles E Metz
1Center for Research in the Implementation of Innovative Strategies in Practice (CRIISP), Iowa City VA Medical Center (152), Iowa City, IA, USA. steve-hillis@uiowa.edu
Academic Radiology
|April 22, 2008
Summary
The Dorfman-Berbaum-Metz (DBM) method for ROC studies has been improved. Recent developments offer clearer interpretations and more significant results in multireader accuracy analyses.
Area of Science:
- Medical Imaging Analysis
- Statistical Methods in Medicine
- Receiver Operating Characteristic (ROC) Analysis
Background:
- The Dorfman-Berbaum-Metz (DBM) method is widely used for multireader ROC studies.
- The original DBM method has limitations including conservative estimates and a lack of a strong theoretical foundation.
- Recent advancements have addressed these drawbacks, proposing improved analytical approaches.
Purpose of the Study:
- To summarize and overview recent developments that enhance the DBM method.
- To provide a consolidated understanding of solutions to the original DBM method's limitations.
- To guide researchers in applying updated DBM methodologies.
Main Methods:
- Review and discussion of recently proposed solutions to DBM method drawbacks.
- Comparative analysis of original and modified DBM procedures.
- Evaluation using simulation studies and real-world medical imaging data.
Main Results:
- The modified DBM procedure demonstrates improved performance compared to the original.
- Simulation studies indicate enhanced accuracy estimation.
- Real data studies show more significant results and clearer interpretation of variance components.
Conclusions:
- The modified DBM procedure, incorporating recent developments, is recommended for ROC analysis.
- Updated methods offer superior statistical performance and interpretability.
- Adoption of these advancements will improve the analysis of multireader ROC studies.

