Development of a performance rubric for transanal endoscopic rectal purse-string sutures

Placing a transanal endoscopic rectal purse-string suture (taEPS) is the crucial first component of transanal total mesorectal excision (taTME). However, no structured training is available to improve the procedure-specific skills for taEPS. The aim of this study was to create a performance rubric to improve taEPS skills and provide preliminary evidence for its validity.

A performance rubric was created based on technical considerations for taEPS, identified by consulting with taTME surgical and performance assessment experts. Ten independent, blinded raters assessed 10 videotaped taEPS procedures of consecutive taTME cases, at National Cancer Center Hospital East (NCCHE), Chiba, Japan, in January 2018-March 2019 using the rubric and the Global Operative Assessment of Laparoscopic Skills (GOALS). Internal consistency and inter-rater reliabilities were calculated. Videotaped taEPS procedures were timed and assessed by the rubric. Correlation between rubric scores and suturing times were analyzed.

The rubric consists of four items: loading the needle (LN), atraumatic needle passage (AP), planned suture path (PS), and overall performance (OA). Videotaped performances were graded on a 3-point Likert scale; scores were calculated as sums of the points. Cronbach's α for internal consistency was 0.713. Inter-rater reliabilities were LN: 0.73, AP: 0.76, PS: 0.71, and OA: 0.70. Rubric and GOALS scores were strongly correlated (r = 0.964, p < 0.001). In 112 consecutive taEPS performances, rubric scores were strongly correlated with suturing time (r =  - 0.69, p < 0.001). Surgeons' experience with taTME was associated with rubric scores and suturing time.

This study provides preliminary validation for the taEPS skill performance rubric. The rubric's structured training may facilitate skill acquisition by providing trainees with critical clinical considerations.