Related Experiment Video
Updated: Jul 13, 2026

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
Published on: October 11, 2018
"Binary" and "non-binary" detection tasks: are current performance measures optimal?
David Gur1, Howard E Rockette, Andriy I Bandos
1Department of Radiology, School of Medicine, University of Pittsburgh, Pittsburgh, PA 15213, USA. gurd@upmc.edu
Abstract:
We have observed that a very large fraction of responses for several detection tasks during the performance of observer studies are in the extreme ranges of lower than 11% or higher than 89% regardless of the actual presence or absence of the abnormality in question or its subjectively rated "subtleness." This observation raises questions regarding the validity and appropriateness of using multicategory rating scales for such detection tasks. Monte Carlo simulation of binary and multicategory ratings for these tasks demonstrate that the use of the former (binary) often results in a less biased and more precise summary index and hence may lead to a higher statistical power for determining differences between modalities.
Related Concept Videos
Receiver Operating Characteristic Plot
Difference from Background: Limit of Detection
The LOD indicates the presence or absence...
High-Performance Liquid Chromatography: Types of Detectors
Detection of Gross Error: The Q Test
Sensitivity, Specificity, and Predicted Value
Sensitivity is the...