Peer Learning in Radiology: Effect of a Pay-for-Performance Initiative on Clinical Impact and Usage

OBJECTIVE. The purpose of this article is to assess the effects of a pay-for-performance (PFP) initiative on clinical impact and usage of a radiology peer learning tool. MATERIALS AND METHODS. This retrospective study was performed at a large academic hospital. On May 1, 2017, a peer learning tool was implemented to facilitate radiologist peer feedback including clinical follow-up, positive feedback, and consultation. Subsequently, PFP target numbers for peer learning tool alerts by subspecialty divisions (October 1, 2017) and individual radiologists (October 1, 2018) were set. The primary outcome was report addendum rate (percent of clinical follow-up alerts with addenda), which was a proxy for peer learning tool clinical impact. Secondary outcomes were peer learning tool usage rate (number of peer learning tool alerts per 1000 radiology reports) and proportion of clinical follow-up alerts (percent of clinical follow-ups among all peer learning tool alerts). Outcomes were assessed biweekly using ANOVA and statistical process control analyses. RESULTS. Among 1,265,839 radiology reports from May 1, 2017, to September 29, 2019, a total of 20,902 peer learning tool alerts were generated. The clinical follow-up alert addendum rate was not significantly different between the period before the PFP initiative (9.9%) and the periods including division-wide (8.3%) and individual (7.9%) PFP initiatives (p = .55; ANOVA). Peer learning tool usage increased from 2.2 alerts per 1000 reports before the PFP initiative to 12.6 per 1000 during the division-wide PFP period (5.7-fold increase; 12.6/2.2), to 25.2 in the individual PFP period (11.5-fold increase vs before PFP; twofold increase vs division-wide) (p < .001). The clinical follow-up alert proportion decreased from 37.5% before the PFP initiative, to 34.4% in the division-wide period, to 31.3% in the individual PFP period. CONCLUSION. A PFP initiative improved radiologist engagement in peer learning by marked increase in peer learning tool usage rate without a change in report addendum rate as a proxy for clinical impact.