Development of a Simulated Objective Structured Clinical Exam for the APPLIED Certification Exam in Anesthesiology: A...

Program directors of anesthesiology residencies agree that it is the program's responsibility to prepare residents for primary American Board of Anesthesiology (ABA) certification, although few report an Objective Standardized Clinical Exam (OSCE) program reflective of the new ABA examination. We created an authentic simulated OSCE (SOSCE) using existing resources to prepare third-year clinical anesthesia residents for the ABA APPLIED exam before graduation and identify knowledge gaps relevant to the OSCE.

Junior anesthesiology residents and medical students acted as standardized patients for the 7 SOSCE stations. Third-year clinical anesthesia residents were evaluated on performance by faculty educators during the SOSCE and completed surveys regarding their experience. Follow-up surveys were distributed to participants after they completed the ABA APPLIED Exam.

Mean scores ranged from 82.6% correct (echocardiogram) to 97.2% correct (ultrasonography). Knowledge gaps were present in competencies explicitly stated as objectives by the ABA. Echocardiography scores improved from 76.1% in the first year to 90.0% in the second year (P = .009). Participants found the SOSCE to be valuable in preparing for the OSCE and the standardized patients' performance to be convincing. Participants felt better prepared for the ABA exam and thought that the SOSCE was authentic in content and process.

An SOSCE program can be developed with preexisting resources. This program was highly rated as useful and informative, an accurate reflection of the ABA OSCE, and helpful in preparation for the examination. Development of a SOSCE program is feasible, sustainable, and valuable.