NS-GUSL: Green U-Shaped Learning for Nuclei Segmentation from Histopathology Images

Nuclei segmentation is a key task in digital histopathology, highlighting important aspects of nuclear morphology and topology in many cancer-related evaluations and studies. Variability in nuclear appearance both within and across different organs, stain heterogeneity, and inconsistencies in acquisition procedures contribute to the complexity of the task. The existing nuclei segmentation methods apply deep learning to address these challenges, using models with millions of parameters, thereby significantly increasing computational complexity. They also face limitations in generalizing to unseen organs and slide preparations. In this paper, we propose a transparent and lightweight Green U-Shaped Learning model for nuclei segmentation (NS-GUSL). NS-GUSL features a multi-scale architecture for coarse-to-fine refinement of probability maps, which are subsequently binarized using a novel low-confidence sample binarization (LCSB) technique. The model features a modular, feed-forward feature learning scheme with unsupervised representation learning and supervised feature selection and generation. A final morphological post-processing step refines the segmentation maps to improve instance separation while preserving nuclei convexity. The model was trained and tested on the MoNuSeg dataset and compared against other deep learning baselines for segmentation performance. In addition, external validation experiments were conducted to evaluate the proposed model's generalizability to unseen organs and staining procedures. NS-GUSL exhibits the best panoptic segmentation performance and competitive detection quality across all datasets. Moreover, our model is shown to be compact, low in computational complexity, and to have a minimal carbon footprint, compared to other deep learning models, making it a suitable choice for deployment on edge devices.