Key Lessons Learned From Implementing a Training Program for Perinatal Patient Safety in a Large Integrated Health...

In 2020, the Women's and Children's Health team at Kaiser Permanente developed an enterprise-wide continuing professional development system designed to deliver a scalable, mastery-based clinical training focused on perinatal patient safety while fulfilling health care regulatory standards.

Using a collaborative design process that relied on interdisciplinary subject matter expert teams, leveraged existing platforms and inexpensive learning software, and incorporated best practices in adult learning, we implemented a complex training program using an innovative learning format and question-level confidence analytics across a large integrated health system. Using the Kirkpatrick Model of Training Evaluation as a framework, we evaluated data from course evaluations including refreshers, quality metrics, and a survey of operational leaders in the Women's and Children's Health service line.

The program demonstrated strong learner engagement and identified clinically relevant knowledge gaps through question-level confidence analytics and showed early indicators of enhanced clinical performance.

Key implementation factors for making a large rollout of clinical education more compelling and effective include using interdisciplinary subject matter experts; creating the training in-house; and a flexible review process to make improvements to the content as needed. This work also demonstrates how a mastery-based, interprofessional continuing professional development system using question-level confidence analytics can identify clinical misperceptions and support iterative curriculum refinement at enterprise scale.