The MacTRAUMA TTL Assessment Tool: Developing a Novel Tool for Assessing Performance of Trauma Trainees: Initial...

Area of Science:

• Medical Education
• Trauma Surgery
• Simulation-based Learning

Background:

• Trauma resuscitation is a complex skill set requiring structured evaluation.
• Current feedback for trainees in trauma resuscitation is often unstructured.
• A novel tool was developed to provide structured formative feedback for trainees leading trauma resuscitations.

Purpose of the Study:

• To develop and assess the psychometric properties of a novel tool for evaluating trainees leading trauma resuscitation.
• To evaluate the feasibility and utility of this new assessment tool.

Main Methods:

• A tool was designed based on learning theories, literature review, and expert opinion, identifying 5 critical domains.
• Interrater reliability was tested using high-fidelity simulation and intraclass correlation coefficients.
• Feasibility, practicality, and utility were assessed via online surveys for raters and trainees.

Main Results:

• Excellent agreement was found for 'initial critical assessment' (0.80), with moderate to good agreement for 'communication and leadership' (0.67) and 'clinical performance' (0.53).
• Agreement was poor for 'decision-making' (0.33), and varied across individual items.
• Raters and trainees confirmed the tool's feasibility and acceptability for formative feedback, with suggestions for enhancement.

Conclusions:

• The MacTrauma TTL assessment tool offers a novel approach to formative feedback in trauma resuscitation.
• Initial psychometric testing indicates promising results, though further validation is required.
• The tool is feasible and acceptable for both trainees and faculty in formative assessment.