[Automatic anatomical site recognition of laryngoscopic images using convolutional neural network]

Objective:To explore the automatic recognition and classification of 20 anatomical sites in laryngoscopy by an artificial intelligence（AI） quality control system using convolutional neural network（CNN）. Methods: Laryngoscopic image data archived from laryngoscopy examinations at the Department of Endoscopy, Cancer Hospital, Chinese Academy of Medical Sciences from January to December 2018 were collected retrospectively, and a CNN model was constructed using Inception-ResNet-V2+SENet. Using 14000 electronic laryngoscope images as the training set, these images were classified into 20 specific anatomical sites including the whole head and neck, and their performance was tested by 2000 laryngoscope images and 10 laryngoscope videos. Results:The average time of the trained CNN model for recognition of each laryngoscopic image was（20.59 ± 1.55） ms, and the overall accuracy of recognition of 20 anatomical sites in laryngoscopic images was 97.75%（1955/2000）, with average sensitivity, specificity, positive predictive value, and negative predictive value of 100%, 99.88%, 97.76%, and 99.88%, respectively. The model had an accuracy of ≥ 99% for the identification of 20 anatomical sites in laryngoscopic videos. Conclusion:This study confirms that the CNN-based AI system can perform accurate and fast classification and identification of anatomical sites in laryngoscopic pictures and videos, which can be used for quality control of photo documentation in laryngoscopy and shows potential application in monitoring the performance of laryngoscopy.