Multimodal artificial intelligence in ophthalmology: Applications, challenges, and future directions
Related Experiment Video
Updated: Sep 14, 2025

In vivo Structural Assessments of Ocular Disease in Rodent Models using Optical Coherence Tomography
Published on: July 24, 2020
Kai Jin1, Tao Yu2, Andrzej Grzybowski3
1Zhejiang University, Eye Center of Second Affiliated Hospital, School of Medicine, Hangzhou, Zhejiang, China; Zhejiang Provincial Key Laboratory of Ophthalmology, Zhejiang Provincial Clinical Research Center for Eye Diseases, Zhejiang Provincial Engineering Institute on Eye Diseases, Hangzhou, Zhejiang, China.
Abstract:
With the rapid development of artificial intelligence (AI) technology, multimodal AI that integrates multiple data modalities has shown tremendous potential in the field of ophthalmology. We systematically evaluate the current applications, technical characteristics, and clinical value of multimodal AI in ophthalmology. We conducted a systematic review following the PRISMA guidelines. We searched relevant literature published from 2018 to 2025 in PubMed, Web of Science, Scopus, and Google Scholar databases. A total of 10 studies were included in the final analysis. The main applications of multimodal AI in ophthalmology include glaucoma, age-related macular degeneration, corneal diseases, ophthalmic emergency triage, cognitive impairment screening, diabetes complication screening, and chatbot-based ophthalmic consultation. Multimodal systems showed superior performance compared to unimodal systems across various application areas, with an Area Under the Curve improvements of 4-5 % and accuracy improvements of 2-7 %. Multimodal AI demonstrates broad application prospects in ophthalmology, providing more comprehensive and accurate diagnostic information. Future research should focus on clinical validation, novel fusion methods, interpretability, and lightweight models to promote the clinical translation of multimodal AI in ophthalmology.
More Related Videos
10:14Author Spotlight: Ex Vivo OCT-Based Multimodal Imaging of Human Donor Eyes for Research into Age-Related Macular Degeneration
Published on: May 26, 2023
12:22Multimodal Volumetric Retinal Imaging by Oblique Scanning Laser Ophthalmoscopy oSLO and Optical Coherence Tomography OCT
Published on: August 4, 2018
Related Concept Videos
Glaucoma: Overview
Angle Closure Glaucoma: Treatment
Open Angle Glaucoma: Treatment
Drugs such as carbonic anhydrase inhibitors, α2- and...