Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

MultiRetNet: A Lightweight Explainable AI Approach to Diabetic Retinopathy Grading and DME Detection Using Fundus-OCT

Saad Islam1, Ravinesh C Deo1, U Rajendra Acharya1

  • 1Artificial Intelligence Applications Laboratory, School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield, QLD 4300, Australia.

Journal of Imaging
|June 25, 2026
PubMed
Summary

Related Concept Videos

Diabetic Retinopathy01:27

Diabetic Retinopathy

DefinitionDiabetic retinopathy is a microvascular complication of diabetes affecting the retinal blood vessels.Risk FactorsDiabetic retinopathy is present in almost all individuals with type 1 diabetes and more than 60% of those with type 2 diabetes after two decades of disease.The risk increases with poor glycemic control, hypertension, dyslipidemia, smoking, pregnancy, and puberty.Although cataracts and glaucoma are also more frequent in people with diabetes, retinopathy remains the leading...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A Robust Deep Learning Approach for COPD Automated Detection.

Sensors (Basel, Switzerland)·2026
Same author

Reply to Dolu, K.O. Comment on "Topaloglu et al. Machine Learning-Driven Lung Sound Analysis: Novel Methodology for Asthma Diagnosis. <i>Adv. Respir. Med.</i> 2025, <i>93</i>, 32".

Advances in respiratory medicine·2026
Same author

TensorCSBP: A Tensor Center-Symmetric Feature Extractor for EEG Odor Detection.

Diagnostics (Basel, Switzerland)·2026
Same author

Passive AI Detection of Stress and Burnout Among Frontline Workers.

Nursing reports (Pavia, Italy)·2025
Same author

TurkerNeXtV2: An Innovative CNN Model for Knee Osteoarthritis Pressure Image Classification.

Diagnostics (Basel, Switzerland)·2025
Same author

Machine Learning-Driven Lung Sound Analysis: Novel Methodology for Asthma Diagnosis.

Advances in respiratory medicine·2025
Same journal

Human-AI Interaction in Interventional Radiology: A Narrative Review of Current Applications, Challenges, and Future Directions.

Journal of imaging·2026
Same journal

Coronary Artery Anomalies and Anatomical Variants: Cross-Sectional Diagnostic Imaging and Clinical Background.

Journal of imaging·2026
Same journal

YoLeTooth: A Unified Framework for Joint Tooth Segmentation and Periapical Lesion Detection in Panoramic Radiographs.

Journal of imaging·2026
Same journal

Radiomics-Guided Multi-Sequence Learning for Pathological Complete Response Prediction from Breast MRI with Missing Auxiliary Sequences.

Journal of imaging·2026
Same journal

Cutaneous Thermography in Arthropathies: Quantitative Imaging, Machine Learning, and Clinical Translation.

Journal of imaging·2026
Same journal

Two-Stage Dynamic Synergistic Segmentation Method for Myocardial Pathology.

Journal of imaging·2026
See all related articles
This summary is machine-generated.

A new deep learning model, MultiRetNet, simultaneously screens for diabetic retinopathy (DR) and diabetic macular edema (DME) using fused eye images. This multimodal approach significantly improves DME detection sensitivity for comprehensive diabetic eye care.

Area of Science:

  • Ophthalmology
  • Artificial Intelligence
  • Medical Imaging

Background:

  • Diabetic retinopathy (DR) and diabetic macular edema (DME) are leading causes of preventable blindness.
  • Current automated screening systems often analyze DR and DME in isolation, using single imaging modalities.
  • This limitation hinders comprehensive and efficient screening for diabetic eye disease.

Purpose of the Study:

  • To develop and evaluate a deep learning model for simultaneous DR severity grading and DME detection.
  • To investigate the efficacy of fusing color fundus and optical coherence tomography (OCT) images for improved diagnostic accuracy.
  • To introduce a novel multimodal architecture, MultiRetNet, for integrated diabetic eye screening.

Main Methods:

  • A deep learning model (MultiRetNet) was designed using two parallel EfficientNet-B0 backbones for feature extraction from paired fundus and OCT images.
Keywords:
Grad-CAMdeep learningdiabetic retinopathyfundus photographyinterpretabilitymultimodal fusionoptical coherence tomography

Related Experiment Videos

  • Feature-level fusion concatenated modality-specific features into a joint representation for multi-task learning.
  • The model was trained and validated on a private dataset of 425 paired eye images, with performance assessed using accuracy, AUC, sensitivity, and specificity.

    • Main Results:

    • The fusion model achieved 82.4% accuracy for DR grading and 97.6% accuracy for DME detection on the test set.
    • Compared to single-modality baselines, the fusion model demonstrated a 43% relative improvement in DME sensitivity (detecting 10/12 DME-positive eyes vs. 7/12).
    • Cross-validation results corroborated these findings, with the fusion model reaching 87.1% DR accuracy and 99.1% DME accuracy.

    Conclusions:

    • Multimodal fusion of fundus and OCT images significantly enhances the performance of automated diabetic eye screening.
    • The proposed MultiRetNet architecture offers a lightweight and effective solution for simultaneously grading DR and detecting DME.
    • This approach represents a promising advancement in comprehensive diabetic eye screening, offering improved diagnostic capabilities over single-modality systems.