Development of a Hospital Outcome Measure Intended for Use With Electronic Health Records: 30-Day Risk-standardized...

Electronic health records (EHRs) offer the opportunity to transform quality improvement by using clinical data for comparing hospital performance without the burden of chart abstraction. However, current performance measures using EHRs are lacking.

With support from the Centers for Medicare & Medicaid Services (CMS), we developed an outcome measure of hospital risk-standardized 30-day mortality rates for patients with acute myocardial infarction for use with EHR data. As no appropriate source of EHR data are currently available, we merged clinical registry data from the Action Registry-Get With The Guidelines with claims data from CMS to develop the risk model (2009 data for development, 2010 data for validation). We selected candidate variables that could be feasibly extracted from current EHRs and do not require changes to standard clinical practice or data collection. We used logistic regression with stepwise selection and bootstrapping simulation for model development.

The final risk model included 5 variables available on presentation: age, heart rate, systolic blood pressure, troponin ratio, and creatinine level. The area under the receiver operating characteristic curve was 0.78. Hospital risk-standardized mortality rates ranged from 9.6% to 13.1%, with a median of 10.7%. The odds of mortality for a high-mortality hospital (+1 SD) were 1.37 times those for a low-mortality hospital (-1 SD).

This measure represents the first outcome measure endorsed by the National Quality Forum for public reporting of hospital quality based on clinical data in the EHR. By being compatible with current clinical practice and existing EHR systems, this measure is a model for future quality improvement measures.