Basic Laparoscopic Skills Assessment Study: Validation and Standard Setting among Canadian Urology Trainees

Area of Science:

• Medical Education
• Surgical Skills Assessment
• Urology

Background:

• Competency-based medical education requires objective assessment standards.
• Laparoscopic skills are crucial in urology training.
• Validating assessment tools is essential for effective surgical education.

Purpose of the Study:

• To develop and validate technical skills standards for urology training.
• To assess basic laparoscopic skills using standardized tasks.
• To evaluate novel assessment platforms for surgical performance.

Main Methods:

• Utilized 4 American Urological Association Basic Laparoscopic Urological Surgery (BLUS) tasks: peg transfer, pattern cutting, suturing/knot tying, and vascular clip applying.
• Assessed performance of 99 urology trainees and 6 attending urologists via video recording.
• Employed time/error scoring, expert global ratings, and Crowd-Sourced Assessments of Technical Skill (C-SATS) for evaluation.

Main Results:

• Laparoscopic experience and training level correlated with performance (p <0.01).
• Attending urologists outperformed trainees, supporting construct validity of the BLUS tasks (p <0.05).
• C-SATS showed strong correlation with traditional assessment methods.

Conclusions:

• The 4 AUA BLUS tasks offer valid evidence for assessing basic laparoscopic skills.
• The C-SATS platform provides a reliable alternative to traditional assessment methods.
• Standard setting methods successfully defined pass-fail cut points for formative and summative assessments.