Related Experiment Video
Updated: Apr 7, 2026

Development of a Virtual Reality Assessment of Everyday Living Skills
Published on: April 23, 2014
Incorporating a non-cognitive selection method in the residency program: the complexities of effective situational
Diantha Soemantri1, Syntia Nusanti1,2, Natalia Widiasih Raharjanti1,3
1Department of Medical Education, Faculty of Medicine Universitas Indonesia, Jakarta, Indonesia.
This study examined the Situational Judgment Test (SJT) item writing process for Indonesian medical residency selection. Findings highlight the need for structured faculty development and continuous feedback to improve SJT validity and inclusivity.
Area of Science:
- Medical Education
- Psychometrics
- Healthcare Workforce Development
Background:
- Medical residency programs are increasingly adopting non-cognitive selection methods.
- Situational Judgment Tests (SJTs) offer a more inclusive approach to candidate assessment.
- Indonesia's accelerating residency training program necessitates refined selection tools.
Purpose of the Study:
- To map the content and characteristics of SJT items used in Indonesian medical residency selection.
- To identify potential biases and limitations in the SJT item writing process.
- To provide recommendations for improving SJT development for residency selection.
Main Methods:
- Twenty-one subject matter experts from 11 residency programs participated as item writers.
- Item writers developed 106 SJT scenarios and response options using a template after test specification development.
- Analysis included domain/content identification and assessment of potential gender, language, and sensitivity biases.
Main Results:
- Commitment to professionalism was the dominant domain in the 106 developed SJT scenarios.
- Scenarios were designed for neutrality regarding language, gender, and sensitivity, with lengths varying from 21 to 145 words.
- Identified drawbacks included an overemphasis on clinical decision-making, specific medical contexts, and insufficient scenario details.
Conclusions:
- Pitfalls such as construct irrelevance and lack of contextual detail were identified in the SJT writing process.
- Structured faculty development is essential to address nuances that could compromise test validity.
- Continuous support and feedback for item writers are crucial for the sustained development and adoption of SJTs in selection.
Related Concept Videos
Methods of Documentation III: PIE
Critical Thinking II
SBAR II: Application of SBAR
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
Guidelines for Writing Outcome
Patient outcomes reflect the patient's response to the goal rather than what the nurse aims to achieve. Terminology should be observable and measurable to avoid the reader's interpretation. The desired outcome should be realistic and achievable in the designated care timeframe. Expected outcomes should align with adjunctive therapies. The outcome should enhance care...
Methods of Documentation II: POMR
The Availability Heuristic

