The reliability and utility of clinical competency assessments for drug monograph preparation by pharmacy students

This educational research project evaluated the utility and reliability of an evaluation system designed to assess the clinical competency of pharmacy students in the preparation and presentation of a comparative drug monograph. The educational program consisted of a mini-course to review drug information resources and skills and a drug information clinical clerkship. The evaluation system for student performance (competency) included 15 criteria (competency areas), a set of descriptors for each criterion, and a scaling mechanism. This competency assessment system for monograph services quantified the overall level of competency and identified specific strong and weak competency areas. The reliability of the system was good in general (standardized alpha-coefficient = 0.701), over time, and among several preceptors. Students indicated that the system was fair and provided them with feedback. Clinical competency assessment should be structured to minimize subjectivity and must be tested for reliability; then, such evaluations can become more consistent and equitable.