Related Experiment Video
Updated: Aug 14, 2026
Multispectral Real-time Fluorescence Imaging for Intraoperative Detection of the Sentinel Lymph Node in Gynecologic Oncology
Published on: October 20, 2010
INTERPRETABLE DEEP LEARNING APPLIED TO FLUORESCENCE CONFOCAL MICROSCOPY FOR INTRAOPERATIVE TISSUE ASSESSMENT IN
Donatella Di Fabrizio1, Agnese Sbrollini2, Edoardo Bindi3,4
1G Salesi Peadiatric Hospital, Pediatric Surgery Unit, Italy, Ancona.
Background:
In pediatric surgical oncology, intraoperative tissue assessment is limited by small specimen size and the absence of real time histopathology. Ex vivo fluorescence confocal microscopy (FCM) provides rapid histology like imaging of fresh tissue, yet interpretation relies on expert visual assessment. We tested the hypothesis that deep learning applied directly to ex vivo FCM images enables automated, accurate, and spatially interpretable tumor detection in pediatric specimens.
Methods:
FCM images were prospectively acquired during routine clinical activity from 42 children, yielding 141 surgical and biopsy specimens. For this analysis, anonymized mosaics were retrospectively collected and expert manually annotated as malignant, benign, or healthy tissue, then decomposed into 256 × 256 pixel tiles at 0.5 µm per pixel. A convolutional neural network was trained, validated, and tested on stratified datasets. Performance metrics were calculated at the tile level using accuracy, sensitivity, specificity, and F1 score. Tile level activation heatmaps were generated to localize regions influencing predictions.
Results:
Overall, 243659 tiles were analyzed, including 124348 malignant, 48441 benign, and 70870 healthy tissue tiles. The independent testing dataset comprised 84751 tiles. Malignant tissue was identified with 91.35% accuracy, 95.88% sensitivity, 86.28% specificity, and an F1 score of 92.13%. Healthy tissue achieved 94.41% accuracy and 95.58% specificity. Benign tissue showed 90.14% accuracy and 91.78% specificity. Heatmaps consistently highlighted at a cellular level the architectural distortion in malignant tiles.
Conclusion:
This work introduces the first pediatric integration of deep learning with ex vivo FCM, demonstrating the feasibility of rapid and interpretable tissue classification and providing the basis for future prospective intraoperative validation.
