Related Experiment Videos
Communicating accuracy of tests to general practitioners: a controlled study.
Johann Steurer1, Joachim E Fischer, Lucas M Bachmann
1Horten-Zentrum für praxisorientierte Forschung und Wissenstransfer, Universitätsspital Zürich, Bolleystrasse 40, Postfach Nord, CH-8091 Zurich, Switzerland. johann.steurer@dim.usz.ch
BMJ (Clinical Research Ed.)
|April 6, 2002
Summary
General practitioners often misinterpret diagnostic test results. Presenting test accuracy information in plain language significantly improves their ability to estimate disease probabilities accurately.
Area of Science:
- Medical Education
- Clinical Decision-Making
- Health Literacy
Background:
- General practitioners (GPs) play a crucial role in interpreting diagnostic test results.
- Accurate estimation of disease probability is essential for effective clinical decision-making.
- Understanding test accuracy metrics like sensitivity and specificity is vital for GPs.
Purpose of the Study:
- To evaluate how different methods of presenting diagnostic test information affect GPs' disease probability estimations.
- To determine the impact of test result only, sensitivity/specificity, and plain-language likelihood ratios on diagnostic accuracy.
Main Methods:
- A controlled questionnaire study was conducted with 263 GPs at three Swiss medical education conferences.
- Participants completed a questionnaire assessing knowledge of test accuracy terms and applied this to a clinical vignette.
- The vignette presented diagnostic test results in three formats: result only, result with sensitivity/specificity, and result with a plain-language likelihood ratio.
Main Results:
- While most GPs knew definitions for sensitivity and positive predictive value, only 22% correctly calculated post-test probability.
- GPs overestimated diagnostic value when shown only the test result (median attributed likelihood ratio [aLR]=9.0).
- Providing sensitivity and specificity reduced overestimation (median aLR=6.0), but plain-language likelihood ratios were most effective (median aLR=3.0).
Conclusions:
- GPs demonstrate a gap between knowing test accuracy definitions and applying them in practice.
- Presenting diagnostic test information in clear, non-technical language enhances GPs' ability to accurately estimate disease probabilities.
- Improving the communication of test accuracy is key to better clinical decision-making.