Interrater Reliability of a Suture Assessment Tool in Family Medicine Training

Procedural competence is essential to clinical practice, yet assessment of technical skills such as suturing remains highly variable and often relies on subjective evaluations. While tools with limited validity evidence exist in surgical specialties, their use in family medicine is limited. This study evaluated the interrater reliability of a suture assessment tool developed by Sundhagen et al when used by family medicine faculty to evaluate the simple interrupted suturing skills of family medicine residents.

In this cross-sectional reliability study, 15 core faculty members from four family medicine residency programs were recruited to evaluate the simple interrupted suturing skills of 20 family medicine residents using a modified suture assessment tool developed by Sundhagen et al. Intraclass correlation coefficients were used to evaluate interrater reliability. Light's κ was calculated for each question.

A total of 15 evaluators assessed 20 videos of resident suturing performance. The Light's κ estimates ranged from 0.11 to 0.50, indicating slight to moderate agreement. None of the items reached the threshold for substantial agreement (κ≥0.61).

The modified Sundhagen suture assessment tool demonstrated fair to moderate reliability when used to evaluate family medicine residents. While the level of agreement limits the tool's effectiveness for standardized summative assessment, the tool may still offer value as a structured framework for formative feedback. Future studies may improve reliability through refined rater training, behaviorally anchored scoring criteria, and the use of visual exemplars.