Related Experiment Video
Updated: Jul 28, 2025

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
Published on: September 4, 2019
Considering the Structured Oral Examinations Beyond Its Psychometrics Properties
Isabelle Boulais1, Kathleen Ouellet2, Elise Vachon Lachiver3
1Department of Medicine, Faculty of Medicine and Health Sciences, Université de Sherbrooke, 3001 12th Avenue North, Sherbrooke, Québec J1H 5N4 Canada.
Structured Oral Examinations (SOE) are often discarded due to poor psychometric properties. However, stakeholder perspectives reveal SOE offers valuable insights into clinical reasoning and authentic assessment, despite challenges.
Area of Science:
- Medical Education
- Assessment in Health Professions Education
Background:
- Structured Oral Examinations (SOE) are frequently invalidated due to concerns regarding their psychometric properties.
- Stakeholder perspectives on SOE are crucial for understanding its overall contribution to assessment.
Purpose of the Study:
- To explore the perceptions of students, assessors, and administrators regarding Structured Oral Examinations (SOE).
- To understand the potential contribution of SOE beyond its psychometric limitations.
Main Methods:
- Focus groups and individual interviews were conducted with key stakeholders.
- Qualitative data analysis was employed to identify themes in stakeholder perceptions.
Main Results:
- Students and assessors viewed SOE as authentic and indicative of clinical reasoning but also as subjective and stressful.
- Administrators highlighted significant organizational and logistical challenges associated with SOE implementation.
- Despite psychometric concerns, positive consequences of SOE were identified.
Conclusions:
- Decisions regarding the utility of SOE should incorporate a broader range of consequences beyond psychometric data.
- Stakeholder feedback provides valuable insights into the perceived strengths and weaknesses of SOE in practice.
- Further consideration of SOE's positive attributes and mitigation of challenges may preserve its role in medical education assessment.
Related Concept Videos
Self-Report Tests of Personality
Assessment of the Mouth
Mouth Inspection
The inspection begins with visually examining the mouth for symmetry, color, and size.
Psychosexual Stages of Personality: Oral
Weaning, typically occurring...
Structuralism
Titchener's approach to structuralism was unique. He...
Reliability and Validity
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...

