Related Experiment Video
Updated: Apr 15, 2026

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography
Published on: November 30, 2022
Multi-Granularity Mask-Guided Network: An Integrated AI Framework for Region-Level Segmentation and Grading of
Yiwen Hu1, Bingyan Hao2,3, Yilin Sun1
1Department of Ophthalmology, Shanghai Tenth People's Hospital, Tongji University School of Medicine, Shanghai 200072, China.
Abstract:
Objective: To develop and validate an artificial intelligence (AI) system for automated lens opacities classification system III (LOCS III)-based grading of all three major cataract subtypes using anterior segment optical coherence tomography (AS-OCT). Methods: This is a single-center cross-sectional study. AS-OCT images were collected and manually graded by ophthalmologists according to LOCS III. The dataset was randomly split into training, validation, and test sets. We propose a novel multi-granularity mask-guided network (MMNet) that jointly performs lens substructure segmentation and severity grading. The model's performance was assessed on an independent test set for automatic grading of cortical cataract (CC), nuclear cataract (NC), and posterior subcapsular cataract (PSC) and the grading performance of the proposed method against ophthalmologists was also evaluated. The model's interpretability was assessed via attention heatmaps and feature visualization. Results: The proposed MMNet exhibited high agreement with ground truth conducted through gold standard. The proportions of predictions with an absolute error < 1.0 for three subtypes range from 83.02% to 89.94%. The model's grading accuracy for cataract subtypes was between 82.20 ± 1.41% and 89.76 ± 1.31% among the three subtypes, the Area Under the Curve (AUC) was between 0.954 (95% CI, 0.952-0.969; p < 0.001) and 0.973 (95% CI, 0.964-0.985; p < 0.001). The MMNet shows a satisfactory mean absolute error (MAE) of 0.14 ± 0.35 in CC, 0.10 ± 0.30 in NC, and 0.17 ± 0.38 in PSC grading. It also achieved a fast grading speed of 0.0178 s/image against manual grading. Conclusions: The proposed AI model presented advanced performance on AS-OCT images in automated LOCS III-based cataract grading for CC and NC, and also showed feasibility in PSC assessment.

