The Clinical Value of Explainable Deep Learning for Diagnosing Fungal Keratitis Using in vivo Confocal Microscopy
Fan Xu1, Li Jiang1, Wenjing He1
1Guangxi Health Commission Key Laboratory of Ophthalmology and Related Systemic Diseases Artificial Intelligence Screening Technology & Research Center of Ophthalmology, Guangxi Academy of Medical Sciences & Department of Ophthalmology, The People's Hospital of Guangxi Zhuang Autonomous Region, Nanning, China.
Abstract:
Background: Artificial intelligence (AI) has great potential to detect fungal keratitis using in vivo confocal microscopy images, but its clinical value remains unclarified. A major limitation of its clinical utility is the lack of explainability and interpretability. Methods: An explainable AI (XAI) system based on Gradient-weighted Class Activation Mapping (Grad-CAM) and Guided Grad-CAM was established. In this randomized controlled trial, nine ophthalmologists (three expert ophthalmologists, three competent ophthalmologists, and three novice ophthalmologists) read images in each of the conditions: unassisted, AI-assisted, or XAI-assisted. In unassisted condition, only the original IVCM images were shown to the readers. AI assistance comprised a histogram of model prediction probability. For XAI assistance, explanatory maps were additionally shown. The accuracy, sensitivity, and specificity were calculated against an adjudicated reference standard. Moreover, the time spent was measured. Results: Both forms of algorithmic assistance increased the accuracy and sensitivity of competent and novice ophthalmologists significantly without reducing specificity. The improvement was more pronounced in XAI-assisted condition than that in AI-assisted condition. Time spent with XAI assistance was not significantly different from that without assistance. Conclusion: AI has shown great promise in improving the accuracy of ophthalmologists. The inexperienced readers are more likely to benefit from the XAI system. With better interpretability and explainability, XAI-assistance can boost ophthalmologist performance beyond what is achievable by the reader alone or with black-box AI assistance.
Insights
Explainable artificial intelligence (XAI) significantly improves fungal keratitis detection accuracy for ophthalmologists, especially novices. This AI-assisted approach enhances diagnostic performance without increasing examination time.
Area of Science:
- Ophthalmology
- Medical Imaging
- Artificial Intelligence
Background:
- Artificial intelligence (AI) shows promise for detecting fungal keratitis from in vivo confocal microscopy (IVCM) images.
- Clinical utility of AI is limited by a lack of explainability and interpretability.
- Explainable AI (XAI) aims to address these limitations by providing insights into AI decision-making.
Purpose of the Study:
- To evaluate the clinical value of an explainable AI (XAI) system for fungal keratitis detection.
- To compare the performance of ophthalmologists with and without AI assistance, including explainable AI.
Main Methods:
- An XAI system using Gradient-weighted Class Activation Mapping (Grad-CAM) and Guided Grad-CAM was developed.
- A randomized controlled trial involved nine ophthalmologists (expert, competent, novice) assessing IVCM images under unassisted, AI-assisted, and XAI-assisted conditions.
- Performance metrics included accuracy, sensitivity, specificity, and time spent; AI assistance provided prediction probabilities, while XAI assistance added explanatory maps.
Main Results:
- Both AI and XAI assistance significantly improved accuracy and sensitivity for competent and novice ophthalmologists, without compromising specificity.
- The performance enhancement was more substantial with XAI assistance compared to standard AI assistance.
- There was no significant difference in the time required for image assessment between XAI-assisted and unassisted conditions.
Conclusions:
- AI demonstrates significant potential to enhance ophthalmologist accuracy in diagnosing fungal keratitis.
- Inexperienced ophthalmologists particularly benefit from XAI systems, improving their diagnostic capabilities.
- XAI's interpretability and explainability can augment ophthalmologist performance beyond unassisted or black-box AI-assisted assessments.
More Related Videos
09:56In Vivo Multimodal Imaging and Analysis of Mouse Laser-Induced Choroidal Neovascularization Model
Published on: January 21, 2018
12:48In Vivo Dynamics of Retinal Microglial Activation During Neurodegeneration: Confocal Ophthalmoscopic Imaging and Cell Morphometry in Mouse Glaucoma
Published on: May 11, 2015
Related Concept Videos
Confocal Fluorescence Microscopy
Three-Dimensional Microscopy in Microbiology
