A deep learning-based dual-branch framework for automated skin lesion segmentation and classification via dermoscopic
Hamza Abu Owida1, Ibrahim Abd El-Fattah2, Suhaila Abuowaida3
1Medical Engineering Department, Faculty of Engineering, Al-Ahliyya Amman University, Amman, 19328, Jordan.
None:
Early skin disease detection significantly improves patient survival rates, yet limited access to dermatological expertise creates an urgent need for automated diagnostic systems. In this paper, we develop a dual-branch deep learning framework that simultaneously performs skin lesion segmentation and classification from dermoscopic images. The proposed segmentation branch uses a modified EfficientNet-B7 encoder with Atrous Spatial Pyramid Pooling (ASPP) for multi-scale feature extraction and transformer blocks for global context modeling. Attention gates and Squeeze-and-Excitation blocks enhance feature selection and boundary precision. The classification branch fuses DenseNet-121 visual features with morphological characteristics extracted from predicted segmentation masks, creating a hybrid appearance-morphology analysis approach. The proposed framework achieved strong and consistent segmentation performance across five benchmark datasets. On HAM10000, the highest Dice score (0.9568) and IoU (0.9242) were recorded, with an accuracy of 0.9708. PH2 achieved a Dice of 0.9250 and a sensitivity of 0.9734, while ISIC 2016 reached a Dice of 0.9298 and an IoU of 0.8811. For ISIC 2017 and ISIC 2018, Dice scores were 0.8972 and 0.9020, respectively. All datasets reported high specificity (> 0.93) and accuracy (> 0.95), confirming the model's robustness and generalization capability. Our dual-branch framework achieves state-of-the-art accuracy by effectively integrating visual appearance and structural morphological features for comprehensive skin lesion analysis. The consistent high performance across diverse datasets indicates strong potential for clinical deployment as a diagnostic support tool.
More Related Videos
04:48Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography
Published on: November 30, 2022
06:34SCAnED - An Open-source Skin Segmentation Macro for Semi-automated Cell and Nuclei Detection in Epidermal and Dermal Skin Compartments
Published on: August 8, 2025
