Related Experiment Videos
Bayes rules for optimally using Bayesian hierarchical regression models in provider profiling to identify
1Institute for Clinical Evaluative Sciences, Toronto, Ontario. peter.austin@ices.on.ca
Insights
Hospital report cards can be improved using decision theory to minimize misclassification costs. The choice of loss function impacts which hospitals are identified, though the effect is minor for most cases.
Area of Science:
- Healthcare analytics
- Biostatistics
- Decision theory
Background:
- Growing use of "hospital report cards" to identify facilities with high mortality rates.
- Bayesian hierarchical models are proposed for provider profiling.
- Misclassification of hospital performance is a known issue, with quantifiable impacts via loss functions.
Purpose of the Study:
- To propose and develop Bayes rules for various loss function families to minimize misclassification costs in hospital report cards.
- To apply these decision rules to a real-world dataset of acute myocardial infarction patients.
Main Methods:
- Development of Bayes rules for generalized 1-0 loss, absolute error loss, and squared error loss functions.
- Application of these rules to a dataset of 19,757 acute myocardial infarction patients across 163 hospitals.
Main Results:
- The number of hospitals identified with high mortality is sensitive to the penalty ratio of false negatives versus false positives.
- The specific choice of loss function family had a limited effect on hospital classification.
Conclusions:
- Hospital report card design can be framed within a decision-theoretic approach to reduce misclassification costs.
- While the loss function choice can influence a small number of hospital classifications, the framework offers a method for cost minimization.
Background:
There is a growing trend towards the production of "hospital report-cards" in which hospitals with higher than acceptable mortality rates are identified. Several commentators have advocated for the use of Bayesian hierarchical models in provider profiling. Several researchers have shown that some degree of misclassification will result when hospital report cards are produced. The impact of misclassifying hospital performance can be quantified using different loss functions.
Methods:
We propose several families of loss functions for hospital report cards and then develop Bayes rules for these families of loss functions. The resultant Bayes rules minimize the expected loss arising from misclassifying hospital performance. We develop Bayes rules for generalized 1-0 loss functions, generalized absolute error loss functions, and for generalized squared error loss functions. We then illustrate the application of these decision rules on a sample of 19,757 patients hospitalized with an acute myocardial infarction at 163 hospitals.
Results:
We found that the number of hospitals classified as having higher than acceptable mortality is affected by the relative penalty assigned to false negatives compared to false positives. However, the choice of loss function family had a lesser impact upon which hospitals were identified as having higher than acceptable mortality.
Conclusion:
The design of hospital report cards can be placed in a decision-theoretic framework. This allows researchers to minimize costs arising from the misclassification of hospitals. The choice of loss function can affect the classification of a small number of hospitals.
Related Concept Videos
Comparing the Survival Analysis of Two or More Groups
Kaplan-Meier Approach
Actuarial Approach
Consider the example of a high-risk surgical procedure with significant early-stage mortality. A two-year clinical study is conducted,...
Parametric Survival Analysis: Weibull and Exponential Methods
Weibull Distribution
The Weibull distribution is a flexible model used in parametric survival analysis. It can handle both increasing and decreasing hazard rates, depending on its shape parameter...
Biostatistics: Overview
Discrete variables are...
Models of Health Promotion and Illness Prevention I
The health belief model (HBM) attempts to predict health-related behavior in specific belief patterns. According to the HBM, a person's...