Related Experiment Video
Updated: Apr 17, 2026
Observational Study Protocol for Repeated Clinical Examination and Critical Care Ultrasonography Within the Simple Intensive Care Studies
Published on: January 16, 2019
Queen's simulation assessment tool: development and validation of an assessment tool for resuscitation objective
Andrew Koch Hall1, Jeffrey Damon Dagnone, Lauren Lacroix
1From the Department of Emergency Medicine (A.K.H., J.D.D.), Department of Community Health and Epidemiology (W.P.), and Faculty of Education (D.A.K.), Queen's University, Kingston; Department of Emergency Medicine (L.L.), University of Ottawa, Ottawa, Ontario, Canada.
Introduction:
The use of high-fidelity simulation is emerging as an effective approach to competency-based assessment in medical education. We aimed to develop and validate a modifiable anchored global assessment scoring tool for simulation-based Objective Structured Clinical Examinations (OSCEs) of resuscitation competence in postgraduate emergency medicine (EM) trainees.
Methods:
The Queen's Simulation Assessment Tool was developed using a modified Delphi technique with a panel of EM physicians. Ten standardized resuscitation OSCE scenarios were administered to EM trainees, and their video-recorded performances were scored by 3 independent and blinded EM attending physicians using the Queen's Simulation Assessment Tool. Correlational analyses and analysis of variance were applied to measure the discriminatory capabilities and interrater reliability of each scenario. A fully crossed generalizability study was conducted for each examination.
Results:
Emergency medicine postgraduate trainees at Queen's University (n = 19-25 per station) participated in the study over 3 years. Interrater reliability showed acceptable levels of agreement for each scenario (mean Spearman ρ = 0.75 [0.63-0.87]; mean interclass correlation coefficient, 0.69 [0.58-0.87]). Discriminatory validity was strong, with senior residents outperforming junior residents in all but 1 of the 10 scenarios. Generalizability studies found the trainee and trainee by scenario interactions as the largest contributors to variance, with G coefficients ranging from 0.67 to 0.84. Resident trainees reported comfort being assessed in the simulation environment (3.8/5) and found the simulation-based examination valuable to their learning (4.6/5).
Conclusions:
This study describes the development and validation of a novel modifiable anchored global assessment scoring tool for simulation-based OSCE assessment of resuscitation competence in postgraduate EM trainees.
Related Concept Videos
01:23Cardiopulmonary Resuscitation III: AED Use
01:21Cardiopulmonary Resuscitation I: Adult
01:23Assessment of Respiration
Subjective Assessment: Nurses interview the patient to gather information directly during the subjective assessment. It includes questions about the individual's medical history, medications, and symptoms, focusing on past respiratory conditions like...
01:30Assessment of Airway, Skin Color, and Use of Accessory Muscles
Introduction
The initial evaluation of a patient's respiratory system...
01:25Assessment of apical radial pulse
The A-R pulse assessment involves simultaneous evaluation of the apical and radial pulses. When the apical and radial pulse rates vary, this assessment helps identify a pulse deficit.
Pre-Procedural Preparation
01:26Exercise Stress Test
Exercise stress testing, commonly known as a treadmill test, is a noninvasive procedure used to evaluate cardiovascular function and diagnose heart conditions.
Definition
An exercise stress test measures the heart's response to exertion using a treadmill or stationary bicycle. Chest electrodes record the heart's electrical activity through an ECG, and blood pressure is monitored regularly.
Purposes