Deep learning-enabled fluorescence imaging for oral cancer margin classification in preclinical models

Oral cancer surgery demands precise margin delineation to ensure complete tumor resection (healthy tissue margin $>5\mathrm{mm}$ ) while preserving postoperative functionality. Inadequate margins most frequently occur at the deep surgical margins, where tumors are located beneath the tissue surface; however, current fluorescent optical imaging systems are limited by their inability to quantify subsurface structures. Combining structured light techniques with deep learning may enable intraoperative margin assessment of 3D surgical specimens.

A deep learning (DL)-enabled spatial frequency domain imaging (SFDI) system is investigated to provide subsurface depth quantification of fluorescent inclusions.

A diffusion theory-based numerical simulation of SFDI was used to generate synthetic images for DL training. ResNet and U-Net convolutional neural networks were developed to predict margin distance (subsurface depth) and fluorophore concentration from fluorescence images and optical property maps. Validation was conducted using in silico SFDI images of composite spherical harmonics, as well as simulated and phantom datasets of patient-derived tongue tumor shapes. Further testing was done in ex vivo animal tissue with fluorescent inclusions.

For oral cancer optical properties, the U-Net DL model predicted the overall depth, concentration, and closest depth with errors of $1.43\pm 1.84\mathrm{mm}$ , $2.26\pm 1.63\mu g/\mathrm{ml}$ , and $0.33\pm 0.31\mathrm{mm}$ , respectively, using in silico patient-derived tongue shapes with closest depths below 10 mm. In PpIX fluorescent phantoms of inclusion depths up to 8 mm, the closest subsurface depth was predicted with an error of $0.57\pm 0.38\mathrm{mm}$ . For ex vivo tissue, the closest distance to the fluorescent inclusions with depths up to 6 mm was predicted with an error of $0.59\pm 0.53\mathrm{mm}$ .

A DL-enabled SFDI system trained with in silico images demonstrates promise in providing margin assessment of oral cancer tumors.