Assessing inter- and intra-rater agreement of four upper digestive endoscopy visibility scores

Although various upper digestive endoscopy visibility scores are available, no comparative studies have directly evaluated them to determine the most effective tool. A prospective study was conducted to evaluate the inter- and intra-rater agreement of four upper digestive endoscopy visibility scores. A dataset of 32 videos was randomly selected from a collection of complete endoscopy procedures. Eight videos were assessed twice to estimate the intra-rater reliability. Eleven evaluators, four of whom had over five years of experience, independently rated the videos using four different scoring systems: Elvas, Kuo, Bhandari, and Chen.