Using the Kirkpatrick model to evaluate a sepsis escape room for advanced pharmacy learners

The purpose of this study was to use the first three levels of the Kirkpatrick Model to evaluate the effectiveness of a simulation center-based escape room activity designed to positively influence student learning.

In this simulation, learners solve puzzles related to care of a critically ill patient. This activity was assessed via an assessment questionnaire (Kirkpatrick level 1), a pre/post learner knowledge quiz and learner self-assessment of skills and attitudes (Kirkpatrick level 2), and unstructured observation of learners upon return to the clinical environment (Kirkpatrick level 3).

Average learner knowledge assessment scores (Kirkpatrick level 2) improved from 80% (pre-) to 90.5% (post-) and learners identified an increased confidence in disease state diagnosis and expression of recommendations (Kirkpatrick level 2). Learner perception of the activity (Kirkpatrick level 1) was positive but also included areas for improvement. Anecdotal reporting supports learners transfer of the knowledge and skills reviewed in the session to practice (Kirkpatrick level 3), but no formal data collection or analysis was completed.

This study provides quantitative and qualitative evidence to support effectiveness of the activity according to Kirkpatrick's Levels 1 and 2, and anecdotal evidence to support effectiveness according to Kirkpatrick's Level 3. Learners had positive perspectives of this activity and demonstrated evidence of increased knowledge and self-reported confidence in skills and attitudes, suggesting this activity has a positive impact on learners in the short-term; however, the data is not robust enough to support conclusions that this activity influences learner practice.