Related Experiment Videos
Multiple imputation to correct for partial verification bias revisited
J A H de Groot1, K J M Janssen, A H Zwinderman
1Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands. j.degroot-17@umcutrecht.nl
Abstract:
Partial verification refers to the situation where a subset of patients is not verified by the reference (gold) standard and is excluded from the analysis. If partial verification is present, the observed (naive) measures of accuracy such as sensitivity and specificity are most likely to be biased. Recently, Harel and Zhou showed that partial verification can be considered as a missing data problem and that multiple imputation (MI) methods can be used to correct for this bias. They claim that even in simple situations where the verification is random within strata of the index test results, the so-called Begg and Greenes (B&G) correction method underestimates sensitivity and overestimates specificity as compared with the MI method. However, we were able to demonstrate that the B&G method produces similar results as MI, and that the claimed difference has been caused by a computational error. Additional research is needed to better understand which correction methods should be preferred in more complex scenarios of missing reference test outcome in diagnostic research.
Insights
Partial verification bias in diagnostic accuracy studies can be corrected using multiple imputation (MI) or the Begg and Greenes (B&G) method. Our findings indicate the B&G method yields similar results to MI, contrary to previous claims.
Area of Science:
- Biostatistics
- Diagnostic Accuracy Research
- Medical Informatics
Background:
- Partial verification bias can significantly skew diagnostic accuracy measures like sensitivity and specificity.
- This bias arises when a subset of patients lacks reference standard verification, leading to exclusion from analysis.
- Multiple imputation (MI) has been proposed as a method to address partial verification bias, treating it as a missing data problem.
Purpose of the Study:
- To re-evaluate the comparison between multiple imputation (MI) and the Begg and Greenes (B&G) correction method for partial verification bias.
- To investigate claims that the B&G method underestimates sensitivity and overestimates specificity compared to MI.
- To clarify the performance of different correction methods in diagnostic research with missing reference outcomes.
Main Methods:
- Comparative analysis of statistical correction methods for partial verification bias.
- Replication and verification of computational results from previous studies.
- Assessment of bias in sensitivity and specificity estimates under different correction scenarios.
Main Results:
- The study demonstrated that the Begg and Greenes (B&G) method produces results comparable to multiple imputation (MI).
- The previously claimed differences between B&G and MI were attributed to a computational error.
- Both methods showed potential for correcting bias in diagnostic accuracy measures.
Conclusions:
- The Begg and Greenes (B&G) method is a viable alternative to multiple imputation (MI) for correcting partial verification bias.
- Further research is necessary to determine the optimal correction methods for complex missing data scenarios in diagnostic studies.
- Accurate statistical methods are crucial for reliable diagnostic accuracy assessment.
Related Concept Videos
Confirmation Biases
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...
Hindsight Biases
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...