A novel loss function to reproduce texture features for deep learning-based MRI-to-CT synthesis

Studies on computed tomography (CT) synthesis based on magnetic resonance imaging (MRI) have mainly focused on pixel-wise consistency, but the texture features of regions of interest (ROIs) have not received appropriate attention.

This study aimed to propose a novel loss function to reproduce texture features of ROIs and pixel-wise consistency for deep learning-based MRI-to-CT synthesis. The method was expected to assist the multi-modality studies for radiomics.

The study retrospectively enrolled 127 patients with nasopharyngeal carcinoma. CT and MRI images were collected for each patient, and then rigidly registered as pre-procession. We proposed a gray-level co-occurrence matrix (GLCM)-based loss function to improve the reproducibility of texture features. This novel loss function could be embedded into the present deep learning-based framework for image synthesis. In this study, a typical image synthesis model was selected as the baseline, which contained a Unet trained mean square error (MSE) loss function. We embedded the proposed loss function and designed experiments to supervise different ROIs to prove its effectiveness. The concordance correlation coefficient (CCC) of the GLCM feature was employed to evaluate the reproducibility of GLCM features, which are typical texture features. Besides, we used a publicly available dataset of brain tumors to verify our loss function.

Compared with the baseline, the proposed method improved the pixel-wise image quality metrics (MAE: 107.5 to 106.8 HU; SSIM: 0.9728 to 0.9730). CCC values of the GLCM features in GTVnx were significantly improved from 0.78 ± 0.12 to 0.82 ± 0.11 (p < 0.05 for paired t-test). Generally, > 90% (22/24) of the GLCM-based features were improved compared with the baseline, where the Informational Measure of Correlation feature was improved the most (CCC: 0.74 to 0.83). For the public dataset, the loss function also shows its effectiveness. With our proposed loss function added, the ability to reproduce texture features was improved in the ROIs.

The proposed method reproduced texture features for MRI-to-CT synthesis, which would benefit radiomics studies based on image multi-modality synthesis.