Modelling multiple thresholds in meta-analysis of diagnostic test accuracy studies.
Susanne Steinhauser1,2, Martin Schumacher1, Gerta Rücker3
1Institute for Medical Biometry and Statistics, Faculty of Medicine and Medical Center - University of Freiburg, Freiburg, Stefan-Meier-Strasse 2679104, Germany.
This new meta-analysis method enhances diagnostic test accuracy by utilizing multiple thresholds from biomarker and questionnaire data. It provides optimal threshold estimations for improved test performance evaluation.
Area of Science:
- Biostatistics
- Medical Diagnostics
- Health Services Research
Background:
- Traditional meta-analyses of diagnostic test accuracy typically use only one sensitivity and specificity pair per study.
- Biomarker and questionnaire-based tests often yield multiple thresholds with associated true/false positive/negative values.
- This limits the comprehensive evaluation of test performance in existing meta-analysis frameworks.
Purpose of the Study:
- To introduce a novel meta-analysis approach that incorporates multiple thresholds for diagnostic tests.
- To leverage additional data from true/false positives/negatives at various thresholds for a more robust analysis.
- To improve the estimation of diagnostic test accuracy and identify optimal thresholds.
Main Methods:
- Estimating underlying biomarker or questionnaire distribution functions in diseased and non-diseased groups.
- Employing linear mixed-effects models on transformed data, assuming normal or logistic distributions.
- Accounting for across-study heterogeneity and the dependence between sensitivity and specificity.
Main Results:
- Generation of a summary receiver operating characteristic (SROC) curve.
- Calculation of pooled sensitivity and specificity across all thresholds.
- Identification of an optimal threshold via Youden index maximization.
- Demonstration with meta-analyses of B-type natriuretic peptide and procalcitonin.
Conclusions:
- The proposed method utilizes all available data for a more complete performance assessment.
- It provides estimations for both biomarker performance and the optimal threshold for diagnostic accuracy.
- This approach enhances the reliability and utility of meta-analyses for diagnostic tests.
Related Concept Videos
Receiver Operating Characteristic Plot
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Sensitivity, Specificity, and Predicted Value
Sensitivity is the...
Comparing the Survival Analysis of Two or More Groups
Testing a Claim about Standard Deviation
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...


