Related Experiment Video
Updated: Aug 16, 2026

Setup and Execution of the Rapid Cycle Deliberate Practice Death Notification Curriculum
Published on: August 5, 2020
Engaging Choice Architecture: Interventions in the Emergency Medicine Standardized Letter (eSLOE 2.0) to Adjust Rater
Sharon Bord1, Doug Franzen2, Erin Karl3
1is an Assistant Professor, Department of Emergency Medicine, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA.
Choice architecture interventions on the electronic Standardized Letter of Evaluation (eSLOE) shifted rating distributions. Prepopulating ratings and requiring justification reduced top scores, aiding applicant differentiation.
Area of Science:
- Medical Education
- Health Professions Education
- Applicant Evaluation
Background:
- Standardized letters of evaluation are increasingly used in residency admissions.
- Current letters have a narrow rating distribution, hindering applicant differentiation.
Purpose of the Study:
- To assess if choice architecture interventions on the eSLOE 2.0 can broaden rating distributions.
- To improve the ability to differentiate between emergency medicine applicants.
Main Methods:
- Two interventions were applied to the eSLOE 2.0 Part B for the 2024-2025 cycle.
- Interventions included prepopulating radio buttons to '3' and prompting justification for '1' or '5' ratings.
- Applicant ratings were compared to two prior application cycles.
Main Results:
- Analysis of 17,727 letters showed a post-intervention decrease in '5' ratings (-12.3% to -19.7%).
- There was an increase in '3' and '4' ratings (+3.9% to +11.0% and +7.2% to +11.0%, respectively).
- '1' and '2' ratings remained stable.
Conclusions:
- Choice architecture, specifically rating prepopulation and justification prompts, altered score distribution.
- These interventions reduced the percentage of top ratings, enhancing score variability for emergency medicine applicants.
Related Concept Videos
Cardiopulmonary Resuscitation II: ACLS Airway Management
Framing Effects
Guidelines for Writing Outcome
Patient outcomes reflect the patient's response to the goal rather than what the nurse aims to achieve. Terminology should be observable and measurable to avoid the reader's interpretation. The desired outcome should be realistic and achievable in the designated care timeframe. Expected outcomes should align with adjunctive therapies. The outcome should enhance care evaluation by...
Ethical Dilemmas II
SBAR II: Application of SBAR
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...