Multiscale Two-Stream Fusion Network for Benggang Classification in Multi-Source Images

Benggangs, a type of soil erosion widely distributed in the hilly and mountainous regions of South China, pose significant challenges to land management and ecological conservation. Accurate identification and assessment of their location and scale are essential for effective Benggang control. With advancements in technology, deep learning has emerged as a critical tool for Benggang classification. However, selecting suitable feature extraction and fusion methods for multi-source image data remains a significant challenge. This study proposes a Benggang classification method based on multiscale features and a two-stream fusion network (MS-TSFN). Key features of targeted Benggang areas, such as slope, aspect, curvature, hill shade, and edge, were extracted from Digital Orthophotography Map (DOM) and Digital Surface Model (DSM) data collected by drones. The two-stream fusion network, with ResNeSt as the backbone, extracted multiscale features from multi-source images and an attention-based feature fusion block was developed to explore complementary associations among features and achieve deep fusion of information across data types. A decision fusion block was employed for global prediction to classify areas as Benggang or non-Benggang. Experimental comparisons of different data inputs and network models revealed that the proposed method outperformed current state-of-the-art approaches in extracting spatial features and textures of Benggangs. The best results were obtained using a combination of DOM data, Canny edge detection, and DSM features in multi-source images. Specifically, the proposed model achieved an accuracy of 92.76%, a precision of 85.00%, a recall of 77.27%, and an F1-score of 0.8059, demonstrating its adaptability and high identification accuracy under complex terrain conditions.