Related Experiment Video
Updated: Jul 24, 2025

Multi-modal Pulmonary Imaging: Using Complementary Information from CT and Hyperpolarized 129Xe MRI to Evaluate Lung Structure-Function
Published on: April 12, 2024
Complementation-reinforced network for integrated reconstruction and segmentation of pulmonary gas MRI with high
Zimeng Li1,2, Sa Xiao2,3, Cheng Wang2,3
1School of Physics, Huazhong University of Science and Technology, Wuhan, China.
Background:
Hyperpolarized (HP) gas MRI enables the clear visualization of lung structure and function. Clinically relevant biomarkers, such as ventilated defect percentage (VDP) derived from this modality can quantify lung ventilation function. However, long imaging time leads to image quality degradation and causes discomfort to the patients. Although accelerating MRI by undersampling k-space data is available, accurate reconstruction and segmentation of lung images are quite challenging at high acceleration factors.
Purpose:
To simultaneously improve the performance of reconstruction and segmentation of pulmonary gas MRI at high acceleration factors by effectively utilizing the complementary information in different tasks.
Methods:
A complementation-reinforced network is proposed, which takes the undersampled images as input and outputs both the reconstructed images and the segmentation results of lung ventilation defects. The proposed network comprises a reconstruction branch and a segmentation branch. To effectively exploit the complementary information, several strategies are designed in the proposed network. Firstly, both branches adopt the encoder-decoder architecture, and their encoders are designed to share convolutional weights for facilitating knowledge transfer. Secondly, a designed feature-selecting block discriminately feeds shared features into decoders of both branches, which can adaptively pick suitable features for each task. Thirdly, the segmentation branch incorporates the lung mask obtained from the reconstructed images to enhance the accuracy of the segmentation results. Lastly, the proposed network is optimized by a tailored loss function that efficiently combines and balances these two tasks, in order to achieve mutual benefits.
Results:
Experimental results on the pulmonary HP 129 Xe MRI dataset (including 43 healthy subjects and 42 patients) show that the proposed network outperforms state-of-the-art methods at high acceleration factors (4, 5, and 6). The peak signal-to-noise ratio (PSNR), structural similarity (SSIM), and Dice score of the proposed network are enhanced to 30.89, 0.875, and 0.892, respectively. Additionally, the VDP obtained from the proposed network has good correlations with that obtained from fully sampled images (r = 0.984). At the highest acceleration factor of 6, the proposed network promotes PSNR, SSIM, and Dice score by 7.79%, 5.39%, and 9.52%, respectively, in comparison to the single-task models.
Conclusion:
The proposed method effectively enhances the reconstruction and segmentation performance at high acceleration factors up to 6. It facilitates fast and high-quality lung imaging and segmentation, and provides valuable support in the clinical diagnosis of lung diseases.
Related Concept Videos
Radiological Investigation II: MRI and Ventilation Perfusion Scan
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
Radiological Investigation III: Pulmonary Angiogram and PET Scan
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
Computed Tomography
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
Magnetic Resonance Imaging
Imaging Studies III: Computed Tomography

