Expert validation of a teamwork assessment rubric: A modified Delphi study

Area of Science:

• Educational Assessment
• Soft Skills Development
• Healthcare Education

Background:

• Teamwork is a crucial employability skill, yet often neglected in undergraduate curricula.
• The TeamUP Rubric assesses teamwork skills in students and facilitates peer feedback.
• Ensuring the validity of assessment tools like the TeamUP Rubric is critical for academic integrity.

Purpose of the Study:

• To determine the extent of expert consensus on the validity of the TeamUP Rubric.
• To establish the TeamUP Rubric as a reliable instrument for evaluating student teamwork.

Main Methods:

• A modified Delphi technique was employed with 35 experts in communications and teamwork.
• Three rounds of surveys, incorporating the TeamUP Rubric, were conducted using mixed methods (face-to-face, telephone, online).
• Quantitative analysis (I-CVI, D-CVI/Ave, S-CVI/Ave) and qualitative Feminist Collaborative Conversations were used to achieve consensus.

Main Results:

• High expert consensus (≥70%) was achieved for all but one behavioral descriptor, which was subsequently modified.
• The TeamUP Rubric (Version 4) demonstrated strong content validity, confirming its suitability for assessment.
• The final rubric is theoretically grounded with distinct, non-overlapping domains.

Conclusions:

• The TeamUP Rubric is a valid and reliable instrument for measuring individual student teamwork skills in higher education.
• The validated TeamUP Rubric can be confidently implemented in university settings for teaching and assessment.