Validity of the Rezum Simulator for Trainees

Simulations have revolutionized surgical training and are an invaluable adjunct tool for augmenting the proficiency of surgeon and patient safety. Before being included in a practical assessment process, simulators need to be using various validity inference frameworks.

We examine the construct validity and reliability of the Rezum simulator.

Seventeen candidates of different professions voluntarily participated in the Rezum simulation workshop. The simulator provides a variety of variable metrics and challenges. Each candidate performed three cases of different difficulty levels with three trials of each case. Validity was measured statistically through a one-way analysis of variance (ANOVA) test, and a p-value of < 0.05 was considered significant. Additional reliability tests were provided, including intraclass correlation coefficients, a Cronbach test (0.7 is considered acceptable), and standard error of measurement.

The ANOVA of total scores among candidates was significant (p = 0.029). Senior registrars and consultants had the highest total scores. Procedure times did not differ significantly among candidates (p = 0.169). The reliability test for the total score was 0.899 (0.831-0.942), with a standard error value of 2.75, a standard deviation of 8.67, and a Cronbach alpha value of 0.915.

We confer the primer evidence of Rezum simulation as a valid, reliable simulator of most of its metrics.