Related Experiment Video
Updated: Mar 28, 2026

Intraoperative Assessment of Resection Margins in Oral Cavity Cancer: This is the Way
Published on: May 10, 2021
Reliable assessment of operative performance
Elif Bilgic1, Yusuke Watanabe2, Katherine McKendy1
1Department of Surgery, Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, 1650 Cedar Avenue, D6-257, Montreal, QC, H3G1A4, Canada.
Generalizability theory (GT) indicates that at least 3 laparoscopic surgery cases are needed for reliable trainee performance assessment using the Global Operative Assessment of Laparoscopic Skills (GOALS) tool. Trainees significantly influence score variance.
Area of Science:
- Surgical Education Research
- Medical Simulation
- Performance Measurement
Background:
- Lack of consensus on reliable intraoperative assessment methods for surgical trainees.
- Generalizability theory (GT) offers a framework to analyze score variance in performance evaluations.
Purpose of the Study:
- To apply GT to identify factors contributing to score variance in laparoscopic skill assessments.
- To determine the optimal number of assessments for reliable trainee performance evaluation.
Main Methods:
- Prospective data collection of laparoscopic procedure assessments using Global Operative Assessment of Laparoscopic Skills (GOALS).
- Trainees were assessed multiple times by attending surgeons over 2-month intervals.
- Reliability coefficients were calculated considering trainees, cases, and raters as factors.
Main Results:
- Eighteen trainees and 65 assessments were analyzed.
- Trainee performance accounted for the largest score variance (66.1%).
- A minimum of 3 cases are required for reliable GOALS scores, with minimal variance attributed to raters (2.3%).
Conclusions:
- Trainee performance is the primary source of variance in GOALS scores.
- Implementing at least 3 cases per trainee enhances the reliability of performance assessments.
- Findings can inform the design of robust surgical training and assessment programs.
Related Concept Videos
Assessment of Ventilation I: Respiratory Rate
A Ventilation assessment is critical for monitoring a patient's health status. Respiration, one of the most accessible vital signs, provides insights into the function of numerous body systems and can indicate serious health issues, such as brainstem injuries from head trauma.
Critical Guidelines for Assessing Ventilation:
Assessment of Airway, Skin Color, and Use of Accessory Muscles
Introduction
The initial evaluation of a patient's respiratory system...
Nursing Evaluation
Assessment of apical radial pulse
The A-R pulse assessment involves simultaneous evaluation of the apical and radial pulses. When the apical and radial pulse rates vary, this assessment helps identify a pulse deficit.
Pre-Procedural Preparation
Peripheral Artery Disease V: Postoperative Nursing Management
Assessment of the Abdomen II: Percussion
Percussion
Percussion is an essential...

