Standard-Setting for Continuing Education Assessment of Select New Competencies

Completion of continuing education hours might not guarantee the achievement of new competencies. Influenza vaccination training was provided to pharmacists in the United Arab Emirates (UAE), who had no similar training in their pharmacy degree. The training was developed and conducted at Gulf Medical University, UAE. Influenza vaccine administration is not yet a privilege for pharmacists in the UAE. This study focuses on determining whether a defensible cut score for the influenza vaccination training multiple-choice questions examination is feasible.

Influenza vaccination training and assessment happened on the same day. The Angoff (modified), Beuk, and Hofstee methods were used for standard-setting. Six subject matter experts who were involved in developing and conducting the first influenza vaccination training in the UAE evaluated the cut score using the Angoff method with the Delphi technique.

The criterion-based cut score was 34.23 of 46 questions, with mean 74% and SD 2.24. Inter-rater reliability was 0.92 with standard errors of judgment 0.29 (0.63%).

The modified Angoff is a credible method to set cut scores, reassured with Beuk and Hofstee methods for assessment of influenza continuing education. It is feasible and perhaps essential to determine a formal cut score for the continuing education assessment of health professionals on select new competencies.