Implementation Requires Evaluation of Adoption: Lessons From a Multimodal Pain Regimen Order Set

Multimodal pain regimen (MMPR) protocols are the standard of care per the 2020 Trauma Quality Improvement Program guidelines. MMPR implementation methodology in trauma services has not been reported. The primary objective of this study was to evaluate the adoption of an MMPR order set at a level 1 trauma center and to describe its implementation. We hypothesized that order set utilization would be about 50%, and barriers to adoption would be related to personal biases.

This was a mixed-methods study at a level 1 trauma center. We retrospectively evaluated MMPR utilization from July 1, 2021 to February 28, 2022. Agile implementation was the method used to implement a clinical decision support tool for the MMPR: a flow chart order set in the electronic medical record. This methodology utilizes short experiment sprints during which data are collected to guide the next iterations. During this process quantitative as well as qualitative data were collected. This included end user testing of the order set and a survey distributed to surgical residents about the order set. Manual thematic network analysis was employed to identify basic and organizing themes from the survey responses.

A total of 587 trauma patients were admitted during the study period and 95 patients (16.2%) had MMPR ordered through the order set. The survey response rate was 19% (13/68). We identified ease of use, desire for options, inadequate education, and assumption of personal expertise as the four basic themes from the survey. These basic themes were further analyzed to two organizing themes: heuristics and overconfidence bias.

The MMPR order set was easy to use but had low adoption at our center in the first 8 months of implementation. Agile implementation methodology provided an ideal framework to identify reasons for low adoption and guide the next sprint to address personal biases, improve heuristics, and provide effective education and dissemination. Evaluation of utilization and qualitative analysis are key components to ensuring clinical decision support tool adoption.