Adversarial learning-based multi-level dense-transmission knowledge distillation for AP-ROP detection

Area of Science:

• Ophthalmology
• Artificial Intelligence
• Medical Imaging

Background:

• Aggressive Posterior Retinopathy of Prematurity (AP-ROP) is a leading cause of blindness in premature infants.
• Automatic diagnosis systems are crucial for AP-ROP detection, but current methods are often too complex for practical deployment.
• Lightweight AI models are needed to mimic the performance of larger, complex models for effective AP-ROP diagnosis.

Purpose of the Study:

• To develop a novel knowledge distillation method for creating efficient AI models for AP-ROP detection.
• To address the complexity limitations of existing automatic diagnosis systems.
• To enable the development of practical, lightweight fundus disease detection devices.

Main Methods:

• Proposed a multi-level dense knowledge distillation method utilizing adversarial learning.
• Employed a pre-trained teacher network to train multiple intermediate teacher-assistant networks and a final student network.
• Implemented dense transmission for knowledge transfer across network levels and adversarial learning to ensure feature similarity between adjacent networks.

Main Results:

• Demonstrated effective knowledge distillation from a complex teacher network to a smaller student network.
• Achieved promising diagnostic performance on both private and public datasets.
• Validated the ability of the proposed method to distill knowledge effectively across multiple network levels.

Conclusions:

• The proposed adversarial learning-based multi-level dense knowledge distillation is effective for creating lightweight AP-ROP detection models.
• This approach facilitates the development of practical, efficient AI systems for diagnosing fundus diseases.
• Offers a new perspective for designing deployable medical imaging diagnostic tools.