Analysis of pharmacy student communication self-evaluation skills during standardized patient encounters

The objective of this study was to evaluate pharmacy students' communication self-evaluation skills by comparing student self-evaluations with those completed by course graders and standardized patients (SP).

As part of a required communications course, third-year pharmacy students completed a medication counseling encounter with a SP during a midpoint encounter and final assessment. Students' communication skills were evaluated by course graders and SPs. Students used the same assessment rubric to also complete self-evaluations immediately after each event and after reviewing a recording of their midpoint encounter. Agreement among student, SP, and course grader ratings on individual items were examined using the kappa statistic.

A total of 206 students completed the midpoint encounter, and 208 completed the final assessment. Agreement between students' and SPs' evaluations was high during both the midpoint and final encounters, with >90% agreement on 14 out of 17 items at the midpoint encounter and 16 out of 17 during the final assessment. There were diffiences in scoring for the use of verbal distractors/fillers, with SPs' evaluations showing more favorable scores when differences existed [at midpoint 69 (33.7%) SP vs. 7 (3.4%) student; at final 31 (15%) SP vs. 3 (1.5%) student]. Agreement improved from the midpoint to final assessment (62.9% vs. 83.7%, respectively).

Self-evaluation of communication skills may be an acceptable alternative to faculty or SP evaluations, when appropriate for the purpose of the activity, based on the high agreement observed among communication skills evaluations completed by students, course graders, and SPs.