Optimal classification and generalized prevalence estimates for diagnostic settings with more than two classes
Related Experiment Video
Updated: Aug 9, 2025

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
Published on: October 11, 2018
Rayanne A Luke1, Anthony J Kearsley2, Paul N Patrone2
1Johns Hopkins University, Department of Applied Mathematics and Statistics, Baltimore, 21218, MD, USA; National Institute of Standards and Technology, Information Technology Laboratory, Gaithersburg, 20899, MD, USA.
Abstract:
An accurate multiclass classification strategy is crucial to interpreting antibody tests. However, traditional methods based on confidence intervals or receiver operating characteristics lack clear extensions to settings with more than two classes. We address this problem by developing a multiclass classification based on probabilistic modeling and optimal decision theory that minimizes the convex combination of false classification rates. The classification process is challenging when the relative fraction of the population in each class, or generalized prevalence, is unknown. Thus, we also develop a method for estimating the generalized prevalence of test data that is independent of classification of the test data. We validate our approach on serological data with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) naïve, previously infected, and vaccinated classes. Synthetic data are used to demonstrate that (i) prevalence estimates are unbiased and converge to true values and (ii) our procedure applies to arbitrary measurement dimensions. In contrast to the binary problem, the multiclass setting offers wide-reaching utility as the most general framework and provides new insight into prevalence estimation best practices.
Related Concept Videos
Classification of Illness
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
Sensitivity, Specificity, and Predicted Value
Sensitivity is the...
Prevalence and Incidence
Prevalence indicates the proportion of individuals in a population who have a specific disease or health...
Receiver Operating Characteristic Plot
Testing a Claim about Population Proportion
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
Mechanistic Models: Compartment Models in Individual and Population Analysis

