Related Experiment Video
Updated: May 30, 2026

Author Spotlight: An Efficient and Robust Software for Automated Fusion of Multiple Preclinical Imaging Modalities
Published on: October 27, 2023
FDPMambaFuse: A frequency-domain and parallel Mamba-based model for multimodal medical image fusion
Baiya Li1, Boheng Zhang2, Yang Liu3
1Department of Otolaryngology Head and Neck Surgery, The First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, 710061, China.
Abstract:
Multimodal medical image fusion (MMIF) integrates complementary information from different imaging modalities, providing more comprehensive and reliable support for clinical diagnosis and analysis. Although Mamba-based models efficiently capture long-range dependencies with low computational cost, existing approaches often overlook frequency-domain features and directional structural information, resulting in insufficient detail preservation and reduced semantic consistency. To address these limitations, we propose FDPMambaFuse, a fusion network that combines frequency-domain decomposition with multi-directional parallel Mamba. The framework employs a multi-level CNN-Mamba feature extractor, in which CNNs capture shallow spatial features, whereas a discrete wavelet transform (DWT)-based parallel Mamba module models multi-scale frequency components, long-range dependencies, and direction-sensitive structural details. A dual-stage fusion module is subsequently introduced to enhance cross-modal complementarity through channel interaction and spatially adaptive attention. In addition, we design an unsupervised hybrid loss that combines pixel-level uncertainty with image gradients to improve structural consistency and overall visual quality. To further improve model generalization, we construct and publicly release a high-quality photoacoustic-ultrasound fusion dataset, HIT-MMIF-PAUS. Extensive qualitative and quantitative experiments demonstrate that FDPMambaFuse outperforms state-of-the-art methods in fusion quality, structural fidelity, and edge clarity. Moreover, it achieves superior accuracy and robustness in downstream tumor segmentation tasks, further verifying its practical potential in clinical applications. Our code is publicly available at https://github.com/670768312/FDPMambaFuse.
Related Concept Videos
Observational Studies
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One example of...
Methods of Documentation VII: EMR
Documentation in Long-Term and Home Healthcare Setting
Long-Term Care Facilities
Introduction to Epidemiology
Pulmonary Embolism II: Diagnostic Studies and Interprofessional Care