Using Self-Rated Examinations to Ensure Competence in Laparoscopy

Area of Science:

• Medical Education
• Surgical Simulation
• Laparoscopic Skills Training

Background:

• Self-assessment in unsupervised laparoscopic training is potentially reliable and cost-effective.
• The study aimed to evaluate the reliability of self-rated performance in basic laparoscopic skills.

Purpose of the Study:

• To explore the reliability of self-rated examinations in basic laparoscopic skills.
• To determine if participants accurately assess their own performance and decide when they have passed tasks.

Main Methods:

• Prospective observational study at a medical simulation center.
• Participants in a basic laparoscopic skills course self-rated performance on the Training and Assessment of Basic Laparoscopic Techniques test.
• Video recordings of all self-assessments were rated by blinded experts for comparison.

Main Results:

• High reliability was found between self-ratings and blinded expert ratings (Intraclass Correlation Coefficient = 0.89, P < 0.001).
• No significant difference was observed between self-rated scores and blinded ratings (mean 451 vs. 455, P = 0.28).
• Participants neither underestimated nor overestimated their performance.

Conclusions:

• Self-rated examinations in basic laparoscopic skills courses demonstrate high reliability.
• Self-assessment accurately reflects performance, without systematic bias.
• Self-rated examinations offer a potentially cost-effective method for assessing surgical trainees.