Reliability of Bayesian probability analysis for predicting coronary artery disease in a veterans hospital

To assess the accuracy of Bayesian probability analysis for the prediction of coronary artery disease, post-test probabilities were generated by the application of three Bayesian algorithms to the clinical and noninvasive test results of 199 patients undergoing angiography in a veterans' hospital. All assumed conditional independence but each used different pre-test and conditional probabilities. Two statistical approaches were employed: (1) Sorting of patients in ascending deciles of probability and comparing expected and observed probabilities in each decile. (2) Calculation of normally distributed reliability statistics which do not depend on probability subsets and the comparison of resulting probability distributions using these statistics. Both statistical approaches revealed that the Bayesian algorithms overestimated disease probability when it was high and underestimated it when low. Though all three algorithms were frequently incorrect, they differed significantly in their accuracies, suggesting that errors in Bayesian analysis are caused by factors other than the assumption of independence. The errors may be due to differences in sensitivity and specificity of tests applied in different institutions.