Decouple-and-Couple Learning in Multi-Modal Brain Tumor Segmentation

Exploiting multi-modal magnetic resonance imaging complementary information for brain tumor segmentation is still a challenging task. Existing methods are usually inclined to learn the joint representation of all tumor regions indiscriminately, thus salient sub-region or healthy tissue would be dominant during the training procedure, which leads to a biased and limited representation performance. In this study, a novel transformer-based multi-modal brain tumor segmentation approach is developed by decoupling and coupling strategy. First, Anatomy-induced Region Decoupler decouples the representation of the tumor scattered in different semantic sub-regions following anatomical view, which forces the model to fully learn intra-region representation separately with multiple modalities context. Additionally, we introduce the collaborative decoupling of the corresponding sub-region edge to serve auxiliary cues. We then design the Edge-supported Intra-region Coupler to separately couple edge and object learning within each anatomical sub-region structure. Lastly, the Mutual Cross-region Coupler is further applied to implement mutual improvement by coupling complementary gains among the above decoupled sub-regions. Extensive experiments clearly demonstrate that our method outperforms current state-of-the-arts for brain tumor segmentation on BRATS2018, BRATS2020, MSD, and BRATS2021 benchmarks while retaining high efficiency in the learning procedure. The code is available at https://github.com/mathwrx/Decouple-and-Couple_Learning_in_Multi-Modal_Brain_Tumor_Segmentation.