Limitations of sensitivity, specificity, likelihood ratio, and bayes' theorem in assessing diagnostic probabilities:

K G Moons1, G A van Es, J W Deckers

  • 1Department of Epidemiology and Biostatistics, Erasmus University Medical School, Rotterdam, The Netherlands.

Insights

The exercise test

Area of Science:

  • Cardiology
  • Diagnostic Imaging
  • Medical Diagnostics

Background:

  • Coronary artery disease (CAD) diagnosis relies on various tests.
  • Exercise testing is a common diagnostic tool for CAD.
  • Understanding test performance across patient subgroups is crucial.

Purpose of the Study:

  • To evaluate how exercise test performance (sensitivity, specificity, likelihood ratio) varies in diagnosing coronary artery disease (CAD) across different patient subgroups.
  • To identify specific patient characteristics influencing exercise test accuracy.

Main Methods:

  • Retrospective analysis of 295 patients with suspected CAD, confirmed by coronary angiography.
  • Assessment of exercise test sensitivity and specificity across subgroups based on sex, blood pressure, workload, and disease severity.
  • Calculation of likelihood ratios for diagnostic probability.

Main Results:

  • Exercise test sensitivity varied significantly by sex (30% in women vs. 64% in men) and number of diseased vessels (39%–77%).
  • Specificity varied by sex (89% in men vs. 97% in women) and relative workload (85%–98%).
  • Likelihood ratios also showed substantial variation (3.8–17.0) across subgroups.

Conclusions:

  • Exercise test diagnostic accuracy is not uniform across all patient subgroups.
  • Patient characteristics significantly impact the reliability of exercise test results for CAD diagnosis.
  • Using standard exercise test parameters for Bayesian probability calculations in individual patients has limitations due to population heterogeneity.

Related Concept Videos

Errors In Hypothesis Tests01:14

Errors In Hypothesis Tests

When performing a hypothesis test, there are four possible outcomes depending on the actual truth (or falseness) of the null hypothesis and the decision to reject or not.
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Sensitivity, Specificity, and Predicted Value01:13

Sensitivity, Specificity, and Predicted Value

In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
Hazard Ratio01:12

Hazard Ratio

The hazard ratio (HR) is a widely used measure in clinical trials to compare the risk of events, such as death or disease recurrence, between two groups over time. It reflects the ratio of hazard rates—the instantaneous risk of the event occurring—between a treatment group and a control group. This measure provides valuable insights into the relative effectiveness of a treatment by assessing how the risk of an event differs between the two groups.
For example, in a clinical trial evaluating a...