Related Experiment Video
Updated: Feb 20, 2026

Setting Up a Stroke Team Algorithm and Conducting Simulation-based Training in the Emergency Department - A Practical Guide
Published on: January 15, 2017
Improving the Clinical Skills Performance of Graduating Medical Students Using "WISE OnCall," a Multimedia
Demian Szyld1, Kristen Uquillas, Brad R Green
1From the Department of Emergency Medicine (D.S.), Brigham and Women's Hospital; The Center for Medical Simulation (D.S.), Boston, MA; New York Simulation Center for the Health Sciences (G.N., T.S.R., A.K.), New York; Institute for Innovations in Medical Education (M.V.P., T.S.R., A.K.), NYU School of Medicine, New York, NY; Department of Obstetrics and Gynecology (K.U.), University of Southern California, Los Angeles, CA; Department of Emergency Medicine (B.R.G.), The Ohio State University, Cleveland, OH; Program for Medical Education and Technology (M.W.N., T.S.R., A.K.), NYU School of Medicine, New York, NY; Department of Journalism (S.D.Y.), Central Connecticut State University; Department of Education (H.S.), Georgian Court University, Lakewood, NJ; Department of Surgery (T.S.R., A.K.), NYU School of Medicine, New York, NY; Department of Medicine (A.K.), Division of General Internal Medicine, Research on Medical Education Outcomes (ROMEO) Unit, and Program for Medical Education Innovation and Research (PrMEIR) (A.K.), NYU School of Medicine, New York, NY.
Introduction:
"Transitions to residency" programs are designed to maximize quality and safety of patient care, as medical students become residents. However, best instructional or readiness assessment practices are not yet established. We sought to study the impact of a screen-based interactive curriculum designed to prepare interns to address common clinical coverage issues (WISE OnCall) on the clinical skills demonstrated in simulation and hypothesize that performance would improve after completing the module.
Methods:
Senior medical students were recruited to participate in this single group prestudy/poststudy. Students responded to a call from a standardized nurse (SN) and assessed a standardized patient (SP) with low urine output, interacted with a 45-minute WISE OnCall module on the assessment and management of oliguria, and then evaluated a different SP with low urine output of a different underlying cause. Standardized patients assessed clinical skills with a 37-item, behaviorally anchored checklist measuring clinical skills (intraclass correlation coefficient [ICC], 0.55-0.81). Standardized nurses rated care quality and safety and collaboration and interprofessional communication using a 33-item literature-based, anchored checklist (ICC, 0.47-0.52). Standardized patient and SN ratings of the same student performance were correlated (r, 0.37-0.62; P < 0.01). Physicians assessed clinical reasoning quality based on the students' patient encounter note (ICC, 0.55-0.68), ratings that did not correlate with SP and SN ratings. We compared pre-post clinical skills performance and clinical reasoning. Fifty-two medical students (31%) completed this institutional review board -approved study.
Results:
Performance as measured by the SPs, SNs, and the postencounter note all showed improvement with mostly moderate to large effect sizes (range of Cohen's d, 0.30-1.88; P < 0.05) after completion of the online module. Unexpectedly, professionalism as rated by the SP was poorer after the module (Cohen's d, -0.93; P = 0.000).
Discussion:
A brief computer-based educational intervention significantly improved graduating medical students' clinical skills needed to be ready for residency.
Related Concept Videos
Nursing Clinical Information System
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:
Coronary Artery Disease V: Interprofessional Care
Acute Coronary Syndrome IV: Interprofessional Care
Cardiomyopathy V: Interprofessional Care
Aneurysm III: Interprofessional Care
Cardiopulmonary Resuscitation V: Advanced Airway Management Techniques

