A hybrid Transformer-CNN framework for uncertainty-guided semi-supervised multiclass eye disease classification with...

The accurate classification of eye diseases such as cataract, diabetic retinopathy (DR), glaucoma, and healthy conditions from fundus images remains a critical challenge in ophthalmology, requiring early diagnosis and treatment to prevent vision loss. Existing deep learning methods rely on large labeled datasets, inefficient use of unlabeled data, and limited interpretability, restricting clinical applicability. To address these limitations, we propose a novel CNN-Transformer hybrid architecture coupled with innovative semi-supervised learning (SSL) and explainability techniques to enhance multiclass eye disease classification. Our methodology integrates a ConvNeXt backbone with Transformer modules, leveraging multi-head attention to effectively capture both spatial features and long-range dependencies. We introduce Uncertainty-Guided MixMatch (UG-MixMatch), a semi-supervised framework that leverages Monte Carlo (MC) dropout for uncertainty quantification and pseudo-label refinement, effectively utilizing both labeled and unlabeled data. For interpretability, we propose a novel Gradient-based Integrated Attention Map (GIAM), which aggregates attention maps across multiple layers. It incorporates adaptive channel-wise weighting, offering more detailed insights into model predictions, surpassing traditional Grad-CAM methods. Evaluated on the Ocular Imaging Health (OIH) dataset of 4215 fundus images across four classes, our approach achieved a 95.27 % classification accuracy using UG-MixMatch and 95.51 % when incorporating MC dropout for direct model evaluation. Cohen's kappa score reached 93.70, indicating near-perfect agreement with the ground truth. Class-wise performance was exceptional, with 100 % sensitivity and specificity for DR and over 95 % specificity for cataract and glaucoma. Robust AUC values were observed, including 1.00 for DR and cataract and 0.99 for glaucoma and healthy cases. GIAM visualizations effectively highlighted disease-relevant regions, offering enhanced clinical interpretability and validation potential. Our framework addresses data scarcity, enhances interpretability, and delivers clinically relevant performance, a promising step towards scalable, explainable, and accurate diagnostic tools for Clinical Decision Support Systems (CDSS) and ophthalmic screening.