Development of an automated ERCP Quality Report Card using structured data fields

Measuring adherence to ERCP quality indicators (QIs) is confounded by variability in indications, maneuvers, and documentation styles. We hypothesized that incorporation of mandatory, structured data fields within reporting software would permit accurate measurement of QI adherence rates and facilitate generation of a provider ERCP report card.

At two referral centers, endoscopy documentation software was modified to generate provider alerts prior to finalizing the note. The alerts reminded the provider to document the following components in a standardized manner: indication, altered anatomy, prior interventions, and QIs deemed high priority by society consensus, study authors, or both. Adherence rates for each QI were calculated in aggregate and by provider via data extraction directly from the procedure documentation software. Medical records were reviewed manually to measure the accuracy of automated data extraction. Accuracy of automated measurement for each QI was calculated against results derived by manual review.

During the 9-month study period, 1,376 ERCP procedures were completed by 8 providers. Manual medical record review confirmed high (98-100%) accuracy of automatic extraction of ERCP QIs from the endoscopy report, including cannulation rate of the native papilla and complete extraction of common bile duct stones. An ERCP report card was generated, allowing for individual comparison of adherence to ERCP QIs with colleagues at their institution and others.

In this pilot study, use of mandatory, structured data fields within clinical ERCP reports permit the accurate measurement of high priority ERCP QIs and the subsequent generation of interval report cards.