Related Experiment Video
Updated: Feb 4, 2026
Objective Nociceptive Assessment in Ventilated ICU Patients: A Feasibility Study Using Pupillometry and the Nociceptive Flexion Reflex
Published on: July 4, 2018
Evaluation of a Measurement System to Assess ICU Team Performance
Aaron S Dietz1,2, Eduardo Salas3, Peter J Pronovost1,2
1The Armstrong Institute for Patient Safety and Quality, The Johns Hopkins University School of Medicine, Baltimore, MD.
Objective:
Measuring teamwork is essential in critical care, but limited observational measurement systems exist for this environment. The objective of this study was to evaluate the reliability and validity of a behavioral marker system for measuring teamwork in ICUs.
Design:
Instances of teamwork were observed by two raters for three tasks: multidisciplinary rounds, nurse-to-nurse handoffs, and retrospective videos of medical students and instructors performing simulated codes. Intraclass correlation coefficients were calculated to assess interrater reliability. Generalizability theory was applied to estimate systematic sources of variance for the three observed team tasks that were associated with instances of teamwork, rater effects, competency effects, and task effects.
Setting:
A 15-bed surgical ICU at a large academic hospital.
Subjects:
One hundred thirty-eight instances of teamwork were observed. Specifically, we observed 88 multidisciplinary rounds, 25 nurse-to-nurse handoffs, and 25 simulated code exercises.
Interventions:
No intervention was conducted for this study.
Measurements And Main Results:
Rater reliability for each overall task ranged from good to excellent correlation (intraclass correlation coefficient, 0.64-0.81), although there were seven cases where reliability was fair and one case where it was poor for specific competencies. Findings from generalizability studies provided evidence that the marker system dependably distinguished among teamwork competencies, providing evidence of construct validity.
Conclusions:
Teamwork in critical care is complex, thereby complicating the judgment of behaviors. The marker system exhibited great potential for differentiating competencies, but findings also revealed that more context specific guidance may be needed to improve rater reliability.
More Related Videos
09:52Setting Up a Stroke Team Algorithm and Conducting Simulation-based Training in the Emergency Department - A Practical Guide
Published on: January 15, 2017
06:52An Inertial Measurement Unit Based Method to Estimate Hip and Knee Joint Kinematics in Team Sport Athletes on the Field
Published on: May 26, 2020
Related Concept Videos
01:21Interdisciplinary Care: The Health Care Team-I
Physicians
The physician's primary responsibility is to diagnose illness and direct the medical or surgical treatment of the condition. The authority to admit patients to a healthcare agency or institution and practice care within that setting is granted to physicians by the healthcare agency or institution...
01:18Interdisciplinary Care: The Health Care Team-II
Physical Therapist
A physical therapist (PT) aims to restore function or prevent additional impairment in a patient following an injury or disease. Massage, heat, cold, water, sonar waves, exercises, and electrical stimulation are some treatments used by PTs to treat...
01:29Pathophysiology of Cardiac Performance
01:27Exercise and Muscle Performance
Endurance exercises
Endurance exercises involve running, swimming, or cycling, which require repetitive movements with low force output. When a person engages in endurance exercise, a few noticeable changes occur in their skeletal muscles. For instance, the number of capillaries...
01:11High-Performance Liquid Chromatography: Introduction
In HPLC, two phases play a critical role in the separation process:
00:57High-Performance Liquid Chromatography: Instrumentation