The mayo high performance teamwork scale: reliability and validity for evaluating key crew resource management skills

Area of Science:

• Medical Education
• Simulation-Based Training
• Teamwork Assessment

Background:

• High-performance teamwork is critical in medicine.
• Assessing teamwork skills in simulation settings requires validated tools.
• Existing measures may not adequately capture nuanced team dynamics.

Purpose of the Study:

• To develop and validate a participant rating scale for high-performance teamwork skills.
• To evaluate the scale's reliability and sensitivity to change.
• To create a practical tool for crisis resource management (CRM) training.

Main Methods:

• Developed the 16-item Mayo High Performance Teamwork Scale (MHPTS).
• Utilized Rasch and traditional psychometric analyses on 273 ratings from 107 participants in CRM training.
• Assessed scale sensitivity to change following simulation exercises.

Main Results:

• MHPTS demonstrated satisfactory internal consistency and construct validity (Rasch and Cronbach's alpha).
• The scale was sensitive to changes in teamwork skills after CRM training.
• Reliability indicators included person reliability of 0.77 and item reliability of 0.96.

Conclusions:

• The MHPTS is a brief, reliable, and practical measure of CRM skills.
• It enables participants to reflect on and evaluate team performance.
• Further validation in diverse medical simulation settings is recommended.