Establishing meaningful benchmarks: the development of a formative feedback tool for advanced laparoscopic suturing

Time and accuracy are commonly used metrics to assess laparoscopic skills in a simulated environment. However, they do not provide trainees with meaningful information about how to improve their skills. The objective of this study was to provide preliminary validity evidence for the creation a formative feedback tool (FFT) for advanced laparoscopic suturing skills.

Videotapes of senior surgical residents (PGY3-5; SRs) and minimally invasive surgeons (MIS) performing 3 advanced laparoscopic suturing tasks were analyzed: needle handling (NH), suturing under tension (UT), and continuous suturing (CS). A FFT was created based on a grounded theory analysis of interviews with MIS surgeons about the key technical aspects of each task. The FFT was used to assess the videotaped performances of SRs and MIS surgeons by two blinded independent raters.

The FFT is composed of three parts: NH contains 10 items, UT 18, and CS 20. Each item was classified according to seven key surgical principles: depth perception, safety, bimanual dexterity, exposure, tissue handling, instrument manipulation, and forward planning. The videotaped performance of SR and MIS surgeons was graded on a 3-point Likert scale ("does well," "needs some improvement," and "does poorly") and scores were calculated as a sum of the points. ICCs for all three tasks were high (NH 0.90, UT 0.87, and CS 0.90). FFT score correlated strongly with combined time and accuracy measurements for UT (0.82, p < 0.01) and CS (0.81, p < 0.01), and moderately for NH (0.65, p < 0.01). MIS surgeons performed significantly better than SRs on UT (p = 0.02) and CS (p = 0.05), while scores on NH were similar (p = 0.57).

A comprehensive tool for providing feedback about advanced laparoscopic suturing skills was developed. The FFT demonstrates evidence for validity as a measure of suturing skills and experience, and provides meaningful information to trainees about how to improve their skills and engage in more deliberate and efficient practice.