Assessing Performance and Engagement on a Computer-Based Education Platform for Pharmacy Practice

A computer-based education platform was developed using a theory-based approach to help Canadian pharmacy professionals adopt their full scope of practice. Data from the platform were used to identify factors that impacted user performance and engagement. A de-identified dataset included response data for 21 unique modules, including quiz responses and self-reflection questions. Outcome measures included user performance (mean quiz score) and engagement (completion rate for attempted modules). Analysis of variance (ANOVA), multivariate regression modelling, and machine learning cluster analysis were used to analyze the data. Of the 5290 users, 68% were pharmacists, 11% were technicians, 13% were pharmacy students, and 8% were pharmacy technician students. Four clusters were identified separately for pharmacists and technicians. Clusters with the higher performance and engagement tended to have more users practicing in community pharmacies while the lower performing clusters tended have more internationally trained users. In the regression modelling, pharmacists performed better than technicians and students while students were more engaged (p < 0.0001). Further, internationally trained pharmacists had slightly lower scores but similar engagement compared to domestically trained pharmacists (p < 0.0001). Users demonstrated higher performance on modules related to scope of practice than on clinical topics, and were most engaged with topics directly impacting daily practice such as influenza vaccinations and new and emerging subjects such as cannabis. The cluster analysis suggests that performance and engagement with a computer-based educational platform in pharmacy may be more related to place of practice than to personal demographic factors such as age or gender.