Related Experiment Video
Updated: Oct 11, 2026

Identification of Disease-related Spatial Covariance Patterns using Neuroimaging Data
Published on: June 26, 2013
Relation of observer agreement to accuracy according to a two-receiver signal detection model of diagnosis
1Department of Radiology, University of Southern California, Los Angeles.
Abstract:
A long-standing problem of medical diagnosis is why rates of observer disagreement are so high. To study this question a model of test interpretation is defined which accounts for disagreement when observers use identical diagnostic strategies. Test subjects are assigned to one of two disease classes on the basis of two parameters: the test score and lambda, the diagnostic certainty, a parameter analogous to signal-to-noise ratio. The rate of disagreement and the mean error rate of independent ideal observers are derived as a function of diagnostic strategy. It follows from the model that: 1) Maximization of the ratio of disagreement to error defines an optimal diagnostic strategy with advantages over maximum likelihood and Bayes diagnostic strategies. 2) Disagreement exceeds error if the sensitivity and specificity of independent observers exceed one-half for all lambda. 3) The ratio of disagreement to error can be no greater than two if test interpretation is dichotomous but can approach infinity for trichotomous interpretation, i.e., if observers are allowed to interpret cases as indeterminate.
Related Concept Videos
Accuracy and Precision
Spearman's Rank Correlation Test
Spearman's test calculates correlation by...
Statistical Analysis: Overview
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
Calibration Curves: Correlation Coefficient
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...
Receiver Operating Characteristic Plot

