Predictive value of ICD-9-CM codes used in vaccine safety research

To assess how well selected ICD-9-CM diagnosis codes predict adverse events; to model bias and power loss when vaccine safety analyses rely on unverified codes.

We extracted chart verification data for ICD-9-CM diagnosis codes from six Vaccine Safety Datalink (VSD) publications and modeled biases and power losses using positive predictive value (PPV) estimates and ranges of code sensitivity.

Positive predictive values were high for type 1 diabetes (80%) in children, relative to WHO criteria, and intussusception (81%) in young children, relative to a standard published case definition. PPVs were moderate (65%) for inpatient and emergency department childhood seizures and low (21%) for outpatient childhood seizures, both relative to physician investigator judgment. Codes for incident central nervous system demyelinating disease in adults had high PPV for inpatient codes (80%) and low PPV for outpatient codes (42%) relative to physicians' diagnoses. Modeled biases were modest, but large increases in frequencies of adverse events are required to achieve adequate power if unverified ICD-9-CM codes are used, especially when vaccine associations are weak.

ICD-9-CM codes for type 1 diabetes in children, intussusception in young children, childhood seizures in inpatient and emergency care settings, and inpatient demyelinating disease in adults were sufficiently predictive for vaccine safety analyses to rely on unverified diagnosis codes. Adverse event misclassification should be accounted for in statistical power calculations.