Consensus-Based Marking Schemes to Assess Competence Using Free-Text Echocardiogram Summary Statements.

Area of Science:

• Cardiology
• Medical Education
• Diagnostic Imaging

Background:

• Transthoracic echocardiography (TTE) report summary statements can assess trainee competence.
• Variability in TTE summary statement wording complicates the development of objective marking schemes.
• A need exists for standardized criteria to evaluate TTE interpretation skills.

Purpose of the Study:

• To develop consensus-based marking schemes for transthoracic echocardiography (TTE) report summary statements.
• To establish essential components for TTE summary statements and identify critical elements for competence.
• To standardize the assessment of TTE interpretation skills among trainees.

Main Methods:

• A modified Delphi approach involving two survey rounds and a consensus meeting was employed.
• Twenty-seven experts participated in the surveys, with eleven attending the final consensus meeting.
• Consensus was defined as greater than 80% agreement among experts.

Main Results:

• Seventy-nine items were identified for inclusion in TTE summary statements.
• Five general items (LV size/function, RV size/function, valves) are recommended for all statements.
• Sixteen items were deemed critical for competence, with left ventricular systolic function being universally critical.

Conclusions:

• The developed marking schemes provide a standardized framework for assessing TTE summary statements.
• Integration of these schemes into competence assessments will enhance cardiology resident training in TTE interpretation.
• Standardization of TTE reporting will improve the reliability and objectivity of competence evaluation.