Promise versus reality: optimism bias in package inserts for tuberculosis diagnostics

Area of Science:

• Medical Diagnostics
• Infectious Disease Research
• Regulatory Science

Background:

• Healthcare professionals utilize diagnostic test package inserts to evaluate test performance.
• Accuracy data in package inserts is crucial for clinical decision-making.
• Previous assessments suggest potential discrepancies in reported diagnostic accuracy.

Purpose of the Study:

• To compare the accuracy estimates for tuberculosis diagnostics as reported in package inserts versus published meta-analyses.
• To identify potential overestimation of diagnostic accuracy in package inserts.
• To evaluate the influence of regulatory approval (FDA) and endorsement (WHO) on reported accuracy.

Main Methods:

• A systematic review and comparison of accuracy data from 19 tuberculosis diagnostic test package inserts.
• Comparison against established accuracy estimates derived from meta-analyses.
• Analysis of package inserts for tests approved by the U.S. Food and Drug Administration (FDA) and/or endorsed by the World Health Organization (WHO).

Main Results:

• Package inserts generally report more optimistic accuracy estimates compared to meta-analyses.
• A trend towards overestimation of diagnostic accuracy was observed in the evaluated package inserts.
• Package inserts for tests approved by the FDA or endorsed by the WHO demonstrated accuracy estimates more consistent with meta-analyses.

Conclusions:

• Diagnostic test package inserts may present an overoptimistic view of test accuracy.
• Regulatory oversight by the FDA and WHO appears to promote more realistic accuracy reporting in package inserts.
• Clinicians and laboratorians should be aware of potential biases in package insert accuracy data, particularly for non-regulated or non-endorsed tests.