Hybrid PET/MRI co-segmentation based on joint fuzzy connectedness and graph cut

Tumor segmentation from hybrid PET/MRI scans may be highly beneficial in radiotherapy treatment planning. Indeed, it gives for both modalities the suitable information that could make the delineation of tumors more accurate than using each one apart. We aim in this work to propose a co-segmentation method that deals with several challenges, notably the lack of one-to-one correspondence between tumors of the two modalities and the boundaries' smoothing.

The proposed method is designed to surpass these limits, we propose a segmentation method based on the GC_sum^max technique. The method takes the advantage of Iterative Relative Fuzzy Connectedness (IRFC) on seeds initialization, and the standard min-cut/max-flow technique for the boundary smoothing. Seed initialization was accurately performed thanks to high uptake regions on PET. Besides, a visibility weighting scheme was adapted to achieve the task of co-segmentation using the IRFC algorithm. Then, given the co-segmented regions, we introduce a morphological-based technique that provides object seeds to standard Graph Cut (GC) allowing it to avoid the shrinking problem. Finally, for each modality, the segmentation task is formulated as an energy minimization problem which is resolved by a min-cut/max-flow technique.

The overlap ratio (denoted DSC) between our segmentation results and the ground-truth for PET images is 92.63  ±  1.03, while the DSC for MRI images is 90.61  ±  3.70.

The proposed method was tested on different types of diseases and it outperformed the state-of-the-art methods. We show its superiority in terms of assymetric relation between PET and MRI and tumors heterogeneity.