Related Experiment Video
Updated: Aug 6, 2026

Improved Registration of 3D CT Angiography with X-ray Fluoroscopy for Image Fusion During Transcatheter Aortic Valve Implantation
Published on: June 3, 2018
Reg-APGAN: Registration-Guided Anatomy-Preserving GAN for CT-to-MR Translation
Abstract:
Computed tomography (CT) is widely accessible for abdominal imaging but provides limited soft-tissue contrast compared with magnetic resonance (MR) imaging. Cross-modality synthesis offers a potential means to virtually complete multimodal protocols, yet current CT-to-MR translation methods often prioritize perceptual realism over anatomical reliability, resulting in geometric distortion and limited downstream utility. To address this gap, we introduce Reg-APGAN, a registration-guided, anatomy-preserving framework that synthesizes MR-like contrast from CT while constraining organ geometry. Using abdominal CT and T1-weighted MR from 114 patients, we convert both modalities into a unified coronal space and perform hierarchical rigid registration using skeletal and multi-organ labels. Reg-APGAN then performs 2D slice-wise translation on rigidly aligned 3D CT-MR volumes under structure-aware supervision to preserve anatomical topology. Evaluation is performed on the full abdominal cavity, a highly deformable and challenging setting for multimodal synthesis. Under identical weak-alignment conditions, Reg-APGAN yields a 0.51 dB PSNR improvement, the highest MS-SSIM, a 6-7% reduction in MAE relative to CycleGAN, and a 13-15% reduction in ROI-based intensity and distributional errors. Moreover, pseudo-MR images generated by Reg-APGAN enabled more anatomically coherent downstream segmentation than CT alone and pseudo-MR images generated by baseline translation methods. By coupling anatomical registration with contrast-level translation, Reg-APGAN enables structurally consistent MR-like visualization from CT and supports multimodal AI development. However, the method is not intended to replace diagnostic MR and requires external validation and radiologist reader studies and external datasets is required.
More Related Videos
06:53Management of Respiratory Motion Artefacts in 18F-fluorodeoxyglucose Positron Emission Tomography using an Amplitude-Based Optimal Respiratory Gating Algorithm
Published on: July 23, 2020
02:09Multi-modal Pulmonary Imaging: Using Complementary Information from CT and Hyperpolarized 129Xe MRI to Evaluate Lung Structure-Function
Published on: April 12, 2024
Related Concept Videos
Imaging Studies III: Computed Tomography
Imaging Studies I: CT and MRI
Description of the Procedures
Computed Tomography (CT) scan:
Computed Tomography (CT) scans use X-ray technology to generate detailed images of bones, organs, and tissues. During the scan, the patient lies on a moving table...
Computed Tomography
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...