Validating exacerbations of asthma in electronic health records: a systematic review

Previous studies have shown that the algorithms and code lists used to define asthma exacerbations vary across different sources of data, if reported at all. Defining and validating asthma exacerbations in electronic health records (EHR) would help to improve future research on asthma using EHR by leading to more consistent and comparable evidence.

We systematically reviewed the literature to evaluate studies that define exacerbations of asthma in EHR and report which algorithms have the highest validity. An adapted version of the QUADAS-2 designed for this review was used to assess risk of bias.

Of the studies yielded by the search, only five met the inclusion criteria. Eligible studies used algorithms that contained codes from versions or modifications of either the 9th or 10th revisions of the International Statistical Classification of Diseases and Related Health (ICD-9 or ICD-10), and validity scores varied. Using the ICD-9 code 493 within algorithms to detect asthma exacerbations, sensitivity scores varied from 44.8% to 91.28% and specificity was >85%. Using the ICD-9 code 493.xx as the principal and secondary diagnosis in claims data, validity measures were all >85%. Using the ICD-10 code J45, scores for sensitivity, specificity and negative predictive value were also all >85%.

Algorithms have been used to identify asthma exacerbations in EHR with varying degrees of validity. Algorithms including the ICD-9 code 493.xx or the ICD-10 code J45 to detect asthma exacerbations had high validity scores. However, there was a risk of bias in these studies and urgent work is needed using robust methods to validate definitions for future research using EHR.