Validity and reliability of a sensor-enabled intubation trainer: a focus on patient-centered data

Area of Science:

• Medical Simulation
• Anesthesiology
• Medical Education

Background:

• Traditional intubation skills assessment relies on observer checklists and global ratings.
• Limitations exist in observer-generated measures for capturing nuanced performance details.

Purpose of the Study:

• To determine if patient-centered simulation data can quantify learner performance in direct laryngoscopy.
• To explore the validity and reliability of sensor-generated data for intubation skill assessment.

Main Methods:

• A pretest/posttest prospective intervention study involving 25 residents.
• Utilized patient-centered simulation with sensor data collection.
• Compared sensor data with observer-generated performance measures.

Main Results:

• Patient-centered simulation variables strongly correlated with observer measures (r = 0.331-0.463, P ≤ 0.001).
• Sensor variables demonstrated moderate to high inter-item reliability (r = 0.259-0.794, P ≤ 0.05).
• Significant improvement noted with Macintosh blade use, but not Miller blade, via observer measures.

Conclusions:

• Sensor-generated simulation data offers a multilevel analysis of intubation skills.
• Provides objective, formative data on patient contact for performance feedback.
• Enables specific criterion measures and detailed performance improvement insights.