Medical student milestones in emergency medicine

Medical education is a continuum from medical school through residency to unsupervised clinical practice. There has been a movement toward competency-based medical education prompted by the Accreditation Council for Graduate Medical Education (ACGME) using milestones to assess competence. While implementation of milestones for residents sets specific standards for transition to internship, there exists a need for the development of competency-based instruments to assess medical students as they progress toward internship. The objective of this study was to develop competency-based milestones for fourth-year medical students completing their emergency medicine (EM) clerkships (regardless of whether the students were planning on entering EM) using a rigorous method to attain validity evidence.

A literature review was performed to develop a list of potential milestones. An expert panel, which included a medical student and 23 faculty members (four program directors, 16 clerkship directors, and five assistant deans) from 19 different institutions, came to consensus on these milestones through two rounds of a modified Delphi protocol. The Delphi technique builds content validity and is an accepted method to develop consensus by eliciting expert opinions through multiple rounds of questionnaires.

Of the initial 39 milestones, 12 were removed at the end of round 1 due to low agreement on importance of the milestone or because of redundancy with other milestones. An additional 12 milestones were revised to improve clarity or eliminate redundancy, and one was added based on expert panelists' suggestions. Of the 28 milestones moving to round 2, consensus with a high level of agreement was achieved for 24. These were mapped to the ACGME EM residency milestone competency domains, as well as the Association of American Medical Colleges (AAMC) core entrustable professional activities for entering residency to improve content validity.

This study found consensus support by experts for a list of 24 milestones relevant to the assessment of fourth-year medical student performance by the completion of their EM clerkships. The findings are useful for development of a valid method for assessing medical student performance as students approach residency.