Related Experiment Video
Updated: Jun 16, 2026

Using Retinal Imaging to Study Dementia
Published on: November 6, 2017
Morphology-aware distillation for lightweight retinal vessel segmentation across fundus photography and OCT
Han Shu1,2, Qi Yuan1, Yizhi Pan2
1School of Information Engineering, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, China.
Introduction:
Retinal vessel segmentation is critical for diagnosing ophthalmic and systemic diseases, yet deploying high-performance models in resource-constrained clinical settings remains a challenge. While Knowledge Distillation (KD) offers a solution for model compression, conventional KD methods often treat the U-Net as a generic feature extractor, neglecting the unique topological nature of vascular networks. This oversight frequently leads to "fractured" segmentation maps in student models, where fine capillaries and continuous vessel branches are lost.
Methods:
In this paper, we advocate a task-specific, morphology-aware distillation strategy for lightweight retinal vessel segmentation. We introduce Morphology-Aware Reconstruction Distillation (MRD), a novel framework designed to transfer the teacher's capability to reconstruct coherent vascular graphs rather than merely mimicking pixel statistics. Central to MRD is the Hierarchical Structure Fusion (HSF) module, a purpose-built unit that adaptively integrates multi-scale features using a tailored residual gating mechanism. By focusing on the decoder's role as a topological reconstruction engine, HSF guides the student to learn how to synthesize continuous vessel structures from compressed representations. We validate our approach across two distinct modalities: Fundus Photography (FIVES and DRIVE datasets) and OCT Angiography (ROSE dataset).
Results:
Extensive experiments demonstrate that our method significantly outperforms existing KD techniques. Notably, our distilled student model achieves diagnostic-level segmentation fidelity that surpasses massive teacher architectures like TransUNet, all while operating with a radically reduced parameter footprint.
Discussion:
By robustly preserving delicate vascular morphology across diverse datasets, these results highlight the strong translational potential of our approach, providing a structurally reliable and highly efficient solution tailored for point-of-care clinical deployment. The code will be released.
