Combining different methods improves assessment of competence in colonoscopy

Area of Science:

• Medical Education
• Gastroenterology
• Surgical Simulation

Background:

• Assessing colonoscopy competence is crucial for patient safety.
• Existing methods may lack comprehensive reliability and objectivity.
• A multi-source approach is needed to enhance assessment accuracy.

Purpose of the Study:

• To develop and validate a reliable method for assessing colonoscopy competence.
• To explore the combination of subjective and objective assessment measures.
• To determine optimal weighting for a composite competence score.

Main Methods:

• Physicians performed simulated colonoscopies, assessed by expert raters and computerized analysis.
• Evaluated metrics included subjective scores, time to cecum, operator movement, and scope movement.
• Reliability (Cronbach's alpha) and composite scores were calculated.

Main Results:

• Individual measures showed varying reliability (0.55–0.92).
• A composite score with equal weighting achieved a reliability of 0.91.
• Optimal weighting of measures yielded a maximum reliability of 0.95.

Conclusions:

• Combining subjective expert ratings with objective automated assessments enhances reliability.
• A multi-faceted approach provides a less biased evaluation of colonoscopy competence.
• This method offers a more robust assessment framework for procedural skills.