Assessing Student Competencies in Antibiotic Stewardship and Patient Counseling

Antibiotic misuse contributes to antibiotic resistance and is a growing public health threat in the United States and globally. Professional medical societies promote antibiotic stewardship education for medical students, ideally before inappropriate practice habits form. To our knowledge, no tools exist to assess medical student competency in antibiotic stewardship and the communication skills necessary to engage patients in this endeavor. The aim of this study was to develop a novel instrument to measure medical students' communication skills and competency in antibiotic stewardship and patient counseling.

We created and pilot tested a novel instrument to assess student competencies in contextual knowledge and communication skills about antibiotic stewardship with standardized patients (SP). Students from two institutions (N=178; Albert Einstein College of Medicine and Warren Alpert Medical School of Brown University) participated in an observed, structured clinical encounter during which SPs trained in the use of the instrument assessed student performance using the novel instrument.

In ranking examinee instrument scores, Cronbach α was 0.64 (95% CI: 0.53 to 0.74) at Einstein and 0.71 (95% CI: 0.60 to 0.79) at Brown, both within a commonly accepted range for estimating reliability. Global ratings and instrument scores were positively correlated (r=0.52, F [3, 174]=30.71, P<.001), providing evidence of concurrent validity.

Similar results at both schools supported external validity. The instrument performed reliably at both institutions under different examination conditions, providing evidence for the validity and utility of this instrument in assessing medical students' skills related to antibiotic stewardship.