Validity of Incident Opioid Use Disorder (OUD) Diagnoses in Administrative Data: a Chart Verification Study

An important strategy to address the opioid overdose epidemic involves identifying people at elevated risk of overdose, particularly those with opioid use disorder (OUD). However, it is unclear to what degree OUD diagnoses in administrative data are inaccurate.

To estimate the prevalence of inaccurate diagnoses of OUD among patients with incident OUD diagnoses.

A random sample of 90 patients with incident OUD diagnoses associated with an index in-person encounter between October 1, 2016, and June 1, 2018, in three Veterans Health Administration medical centers.

Direct chart review of all encounter notes, referrals, prescriptions, and laboratory values within a 120-day window before and after the index encounter. Using all available chart data, we determined whether the diagnosis of OUD was likely accurate, likely inaccurate, or of indeterminate accuracy. We then performed a bivariate analysis to assess demographic or clinical characteristics associated with likely inaccurate diagnoses.

We identified 1337 veterans with incident OUD diagnoses. In the chart verification subsample, we assessed 26 (29%) OUD diagnoses as likely inaccurate; 20 due to systems error and 6 due to clinical error; additionally, 8 had insufficient information to determine accuracy. Veterans with likely inaccurate diagnoses were more likely to be younger and prescribed opioids for pain. Clinical settings associated with likely inaccurate diagnoses were non-mental health clinical settings, group visits, and non-patient care settings.

Our study identified significant levels of likely inaccurate OUD diagnoses among veterans with incident OUD diagnoses. The majority of these cases reflected readily addressable systems errors. The smaller proportion due to clinical errors and those with insufficient documentation may be addressed by increased training for clinicians. If these inaccuracies are prevalent throughout the VHA, they could complicate health services research and health systems responses.