Combined multiplex panel test results are a poor estimate of disease prevalence without adjustment for test error

Robert Challen1,2, Anastasia Chatzilena1,2, George Qian1,2

  • 1Bristol Vaccine Centre, Schools of Population Health Sciences and of Cellular and Molecular Medicine, University of Bristol, Bristol, United Kingdom.

PubMed

Insights

Multiplex panel tests can accumulate significant error from individual test inaccuracies, leading to biased disease prevalence estimates. Novel statistical methods are presented to correct this bias and quantify uncertainty in multiplex testing results.

Area of Science:

  • Clinical diagnostics and epidemiology
  • Statistical methodology in healthcare

Background:

  • Multiplex panel tests simultaneously detect multiple pathogens using numerous component tests.
  • Large component numbers in multiplex panels can amplify individual test errors, impacting overall accuracy.
  • Estimating disease prevalence from multiplex tests is challenged by cumulative error, uncertainty, and bias.

Purpose of the Study:

  • To develop a mathematical framework for characterizing error accumulation in multiplex panel tests.
  • To derive expressions for the sensitivity and specificity of multiplex panel tests.
  • To present novel statistical methods for bias adjustment and uncertainty quantification in prevalence estimates.

Main Methods:

  • Development of a mathematical framework to analyze error propagation in multiplex tests.
  • Derivation of analytical expressions for panel test sensitivity and specificity.
  • Simulation studies to validate proposed statistical methods for bias correction and uncertainty quantification.

Main Results:

  • Identified a counter-intuitive inverse relationship between panel test sensitivity and disease prevalence.
  • Demonstrated that cumulative test error significantly biases disease prevalence estimates.
  • Validated novel statistical methods for adjusting bias and quantifying uncertainty in multiplex test results.

Conclusions:

  • Multiplex panel tests require robust statistical methods to address cumulative error and bias.
  • Accurate disease prevalence estimation necessitates correcting for inherent uncertainties in multiplex testing.
  • The developed methods are crucial for reliable clinical application of increasingly common multiplex screening.

Related Concept Videos

Testing a Claim about Population Proportion01:24

Testing a Claim about Population Proportion

A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
Multiple Comparison Tests01:13

Multiple Comparison Tests

Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Detection of Gross Error: The Q Test01:00

Detection of Gross Error: The Q Test

When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...
Sensitivity, Specificity, and Predicted Value01:13

Sensitivity, Specificity, and Predicted Value

In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Bias in Epidemiological Studies01:29

Bias in Epidemiological Studies

Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is: