Assessing the validity of an OSCE developed to assess rare, emergent or complex clinical conditions in endocrinology & metabolism
Related Experiment Video
Updated: Nov 5, 2025
Author Spotlight: Assessing the Cardiovascular Profile of Patients with Metabolic Syndrome
Published on: September 27, 2024
Stephanie Dizon1,2,3, Janine C Malcolm4,5,6, Jan-Joost Rethans7
1Department of Medicine, The Ottawa Hospital, 1967 Riverside Drive, 4th Floor, Ontario, K1H 7W9, Ottawa, Canada. steph.dizon@gmail.com.
Background:
Assessment of emergent, rare or complex medical conditions in Endocrinology and Metabolism (E&M) is an integral component of training. However, data is lacking on how this could be best achieved. The purpose of this study was to develop and administer an Objective Structured Clinical Examination (OSCE) for E&M residents, and to gather validity evidence for its use.
Methods:
A needs assessment survey was distributed to all Canadian E&M Program Directors and recent graduates to determine which topics to include in the OSCE. The top 5 topics were selected using a modified Delphi technique. OSCE cases based on these topics were subsequently developed. Five E&M residents (PGY4-5) and five junior Internal Medicine (IM) residents participated in the OSCE. Performance of E&M and IM residents was compared and results were analyzed using a Generalizability study. Examiners and candidates completed a survey following the OSCE to evaluate their experiences.
Results:
The mean score of IM and E&M residents was 41.7 and 69.3 % (p < 0.001), respectively, with a large effect size (partial η2 = 0.75). Overall reliability of the OSCE was 0.74. Standard setting using a borderline regression method resulted in a pass rate of 100 % of E&M residents and 0 % of IM residents. All residents felt the OSCE had high value for learning as a formative exam.
Conclusions:
The E&M OSCE is a feasible method for assessing emergent, rare and complex medical conditions and this study provides validity evidence to support its use in a competency-based curriculum.
More Related Videos
08:35Oxygenation-sensitive Cardiac MRI with Vasoactive Breathing Maneuvers for the Non-invasive Assessment of Coronary Microvascular Dysfunction
Published on: August 17, 2022
10:38Observational Study Protocol for Repeated Clinical Examination and Critical Care Ultrasonography Within the Simple Intensive Care Studies
Published on: January 16, 2019
Related Concept Videos
01:29Assessment of the Cardiovascular System II: Inspection
Head and Neck
01:23Assessment of the Cardiovascular System I: Subjective Data
Initial Enquiry
Ask the patient about their primary concern and thoroughly explore all reported symptoms.
Medical History
Investigate past illnesses affecting the cardiovascular system, such as angina, anemia, rheumatic fever, congenital heart disease, stroke, thrombophlebitis, dysrhythmias, varicosities
Inquire about symptoms...
01:30Assessment of Airway, Skin Color, and Use of Accessory Muscles
Introduction
The initial evaluation of a patient's respiratory system...
01:27Assessment of the Cardiovascular System III: Palpation
Jugular Venous Pressure (JVP) Measurement
Position the patient at a thirty- to forty-five-degree angle or in a semi-fowler's position. Look for the highest point of pulsation in the internal jugular vein and measure the vertical distance to the angle of Loius or sternal angle. A normal JVP is 3-4 cm above...
01:17Assessment of Diffusion and Perfusion
The Role of Diffusion in Respiration
Diffusion is the process by which molecules move from an area of higher concentration to an area of lower concentration. In the respiratory system, this...
01:05Data Collection III
The principles to begin the physical assessment include conducting a comprehensive or problem-related history in a quiet, well-lit room, emphasizing privacy and comfort for the...