The impact of COVID-19 on a high-volume incident learning system: A retrospective analysis

The purpose of this work was to assess how the coronavirus disease 2019 (COVID-19) pandemic impacted our incident learning system data and communicate the impact of a major exogenous event on radiation oncology clinical practice.

Trends in our electronic incident reporting system were analyzed to ascertain the impact of the COVID-19 pandemic, including any direct clinical changes. Incident reports submitted in the 18 months prior to the pandemic (September 14, 2018 to March 13, 2020) and reports submitted during the first 18 months of the pandemic (March 14, 2020 to September 13, 2021) were compared. The incident reports include several data elements that were evaluated for trends between the two time periods, and statistical analysis was performed to compare the proportions of reports.

In the 18 months prior to COVID-19, 192 reports were submitted per 1000 planning tasks (n = 832 total). In the first 18 months of the pandemic, 147 reports per 1000 planning tasks were submitted (n = 601 total), a decrease of 23.4%. Statistical analysis revealed that there were no significant changes among the data elements between the pre- and during COVID-19 time periods. An analysis of the free-text narratives in the reports found that phrases related to pretreatment imaging were common before COVID-19 but not during. Conversely, phrases related to intravenous contrast, consent for computed tomography, and adaptive radiotherapy became common during COVID-19.

The data elements captured by our incident learning system were stable after the onset of the COVID-19 pandemic, with no statistically significant findings after correction for multiple comparisons. A trend toward fewer reports submitted for low-risk issues was observed. The methods used in the work can be generalized to events with a large-scale impact on the clinic or to monitor an incident learning system to drive future improvement activities.