Related Experiment Video
Updated: Apr 19, 2026

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Using individual patient data to adjust for indirectness did not successfully remove the bias in this case of
Junfeng Wang1, Patrick Bossuyt1, Ronald Geskus1
1Department of Clinical Epidemiology, Biostatistics & Bioinformatics, Academic Medical Center, PO Box 22700, 1100 DE Amsterdam, The Netherlands.
Objectives:
In comparative systematic reviews of diagnostic accuracy, inconsistencies between direct and indirect comparisons may lead to bias. We investigated whether using individual patient data (IPD) can adjust for this form of bias.
Study Design And Setting:
We included IPD of 3 ovarian reserve tests from 32 studies. Inconsistency was defined as a statistically significant difference in relative accuracy or different comparative results between the direct and indirect evidence. We adjusted for the effect of threshold and reference standard, as well as for patient-specific variables.
Results:
Anti-Müllerian hormone (AMH) and follicle stimulation hormone (FSH) differed significantly in sensitivity (-0.1563, P = 0.04). AMH and antral follicle count (AFC) differed significantly in sensitivity (0.1465, P < 0.01). AMH and AFC differed significantly in specificity (-0.0607, P = 0.02). The area under the curve (AUC) differed significantly between AFC and FSH (0.0948, P < 0.01) in the direct comparison but not (0.0678, P = 0.09) in the indirect comparison. The AUCs of AFC and AMH differed significantly (-0.0830, P < 0.01) in the indirect comparison but not (-0.0176, P = 0.29) in the direct comparison. These differences remained after adjusting for indirectness.
Conclusion:
Estimates of comparative accuracy obtained through indirect comparisons are not always consistent with those obtained through direct comparisons. Using IPD to adjust for indirectness did not successfully remove the bias in this case study.
Related Concept Videos
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Blinding
Confounding in Epidemiological Studies
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
Blind Procedures

