Related Experiment Videos
Lightweight Semantic Perception from UAV-Borne Visual Sensors via Conflict-Suppressed Heterogeneous Expert
Feng Ouyang1,2, Yongpeng Ding1,2, Miao Qin1,2
1College of Intelligent Technology, Tianfu College of Southwestern University of Finance and Economics, Mianyang 621000, China.
Abstract:
UAV-borne visual sensors provide high-resolution aerial observations for low-altitude scene understanding, urban monitoring, traffic observation, emergency inspection, and infrastructure assessment. However, semantic perception from UAV visual sensor data remains challenging because aerial images often contain dense small objects, elongated road structures, fragmented boundaries, scale variations caused by flight-altitude changes, oblique viewpoints, and strict onboard or edge computational constraints. To address these challenges, this paper proposes MEKD-UAVSeg, a lightweight semantic perception framework based on conflict-suppressed heterogeneous expert distillation. During training, a Transformer-based semantic expert provides global contextual understanding and region-level class consistency, while a Mamba-based spatial expert provides complementary structural guidance for roads, roofs, boundaries, and other continuous aerial structures. Both experts are used only during training, and the final inference model remains a compact CNN-based segmentation network. In addition, UAV-aware density and hard-region priors are designed to emphasize small-object-dense areas, boundary-sensitive regions, rare classes, and uncertain aerial categories. A conflict-suppressed reliability routing strategy is further developed to reduce inconsistent supervision between heterogeneous experts and selectively transfer reliable knowledge to the student model. Experiments on UAVid and UDD6 demonstrate that the proposed framework achieves a favorable accuracy-efficiency trade-off compared with representative CNN-, Transformer-, Mamba-, and hybrid-based UAV segmentation methods, without introducing expert-induced inference complexity.