Related Experiment Video
Updated: Aug 29, 2025

Observational Study Protocol for Repeated Clinical Examination and Critical Care Ultrasonography Within the Simple Intensive Care Studies
Published on: January 16, 2019
Competency assessment of residents of Intensive Care Medicine through a simulation-based objective structured
Á Castellanos-Ortega1, M J Broch1, D Palacios-Castañeda2
1Intensive Care Department, Hospital Universitario y Politécnico La Fe, Valencia, Spain.
Objectives:
The current official model of training in Intensive Care Medicine (ICM) in Spain is based on exposure to experiences through clinical rotations. The main objective was to determine the level of competency (I novice to V independent practitioner) achieved by the residents at the end of the 3rd year of training (R3) in ICM through a simulation-based OSCE. Secondary objectives were: (1) To identify gaps in performance, and (2) To investigate the reliability and feasibility of conducting simulation-based assessment at multiple sites.
Design:
Observational multicenter study.
Setting:
Thirteen Spanish ICU Departments.
Participants:
Thirty six R3.
Intervention:
The participants performed on five, 15-min, high-fidelity crisis scenarios in four simulation centers. The performances were video recorded for later scoring by trained raters.
Main Variables Of Interest:
Via a Delphi technique, an independent panel of expert intensivists identified critical essential performance elements (CEPE) for each scenario to define the levels of competency.
Results:
A total of 176 performances were analyzed. The internal consistency of the check-lists were adequate (KR-20 range 0.64-0.79). Inter-rater reliability was strong [median Intraclass Correlation Coefficient across scenarios: 0.89 (0.65-0.97)]. Competency levels achieved by R3 were: Level I (18.8%), II (35.2%), III (42.6%), IV/V (3.4%). Overall, a great heterogeneity in performance was observed.
Conclusion:
The expected level of competency after one year in the ICU was achieved only in half of the performances. A more evidence-based educational approach is needed. Multiple center simulation-based assessment showed feasibility and reliability as an evaluation method of competency.
Trial Registration:
COBALIDATION. NCT04278976. (https://register.
Clinicaltrials:
gov).
More Related Videos
05:04Author Spotlight: Evaluating Clinicians' Adoption of Ultrasound-Guided Vascular Cannulation Through Simulation Training
Published on: August 9, 2024
09:52Setting Up a Stroke Team Algorithm and Conducting Simulation-based Training in the Emergency Department - A Practical Guide
Published on: January 15, 2017
Related Concept Videos
Acute Coronary Syndrome IV: Interprofessional Care
Assessment of Respiration
Subjective Assessment: Nurses interview the patient to gather information directly during the subjective assessment. It includes questions about the individual's medical history, medications, and symptoms, focusing on past respiratory conditions like...
Pulmonary Embolism II: Diagnostic Studies and Interprofessional Care
Assessment of Ventilation I: Respiratory Rate
A Ventilation assessment is critical for monitoring a patient's health status. Respiration, one of the most accessible vital signs, provides insights into the function of numerous body systems and can indicate serious health issues, such as brainstem injuries from head trauma.
Critical Guidelines for Assessing Ventilation:
Chronic Obstructive Pulmonary Disease-IV: Assessement and Diagnostic Studies
Medical History
Coronary Artery Disease V: Interprofessional Care