Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Search research articles

Related Experiment Video

Updated: Aug 28, 2025

Author Spotlight: An Efficient and Robust Software for Automated Fusion of Multiple Preclinical Imaging Modalities

Author Spotlight: An Efficient and Robust Software for Automated Fusion of Multiple Preclinical Imaging Modalities

Published on: October 27, 2023

Cross-modal attention for multi-modal image registration.

Xinrui Song¹, Hanqing Chao¹, Xuanang Xu¹

¹Department of Biomedical Engineering and Center for Biotechnology and Interdisciplinary Studies, Rensselaer Polytechnic Institute, Troy, NY 12180, USA.

Medical Image Analysis

|September 20, 2022

Summary

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Reducing False-Positives Due to Urinary Stagnation in the Prostatic Urethra on 18 F-DCFPyL PSMA PET/CT With MRI.

Clinical nuclear medicine·2024

Same author

PRECISE Version 2: Updated Recommendations for Reporting Prostate Magnetic Resonance Imaging in Patients on Active Surveillance for Prostate Cancer.

European urology·2024

Same author

Automated prostate gland segmentation in challenging clinical cases: comparison of three artificial intelligence methods.

Abdominal radiology (New York)·2024

Same author

Evaluating Diagnostic Accuracy and Inter-reader Agreement of the Prostate Imaging After Focal Ablation Scoring System.

European urology open science·2024

Same author

A Phase 1 Trial of Salvage Stereotactic Body Radiation Therapy for Radiorecurrent Prostate Cancer After Brachytherapy.

International journal of radiation oncology, biology, physics·2024

Same author

Localized high-risk prostate cancer harbors an androgen receptor low subpopulation susceptible to HER2 inhibition.

medRxiv : the preprint server for health sciences·2024

Same journal

Wavelet-inspired diffusion model with near-field constraint for real-time echocardiography dehazing.

Medical image analysis·2026

Same journal

Co-assistant networks by pathology foundation model and convolutional neural network for gigapixel whole slide image analysis.

Medical image analysis·2026

Same journal

MBAS2024: A large-scale benchmark for multi-class bi-atrial segmentation in multi-center contrast-enhanced MRIs.

Medical image analysis·2026

Same journal

Respiratory motion augmentation for personalized super-resolution (RMApSR) of 3D cine MR images in MRI-guided radiotherapy.

Medical image analysis·2026

Same journal

Biom3d, a modular framework to host and develop 3D segmentation methods.

Medical image analysis·2026

Same journal

Embracing intra-class heterogeneity for semi-supervised medical image segmentation: From diversity to precision.

Medical image analysis·2026

See all related articles

This summary is machine-generated.

This study introduces a novel cross-modal attention mechanism for medical image registration, improving spatial correspondence between multi-modal images. The method significantly outperforms existing convolutional neural networks (CNNs) in MR-TRUS registration tasks.

Area of Science:

Medical Imaging
Computer Vision
Deep Learning

Background:

Convolutional Neural Networks (CNNs) excel at feature extraction but struggle with spatial correspondence in medical image registration.
Multi-modal image registration is challenging due to significant appearance differences between input images.

Purpose of the Study:

To develop a novel cross-modal attention mechanism for improved multi-modal image registration.
To enhance feature correlation and mapping for accurate image registration transformations.
To improve the interpretability of deep learning-based image registration methods.

Main Methods:

A novel cross-modal attention mechanism is proposed to correlate features from multi-modal images.
Contrastive learning-based pre-training is used to extract high-level cross-modal features.

Keywords:

Cross-modal attention Deep learning Multi-modal registration Prostate caner imaging

More Related Videos

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers

Published on: January 18, 2020

Methods to Test Visual Attention Online

Methods to Test Visual Attention Online

Published on: February 19, 2015

Related Experiment Videos

Last Updated: Aug 28, 2025

Author Spotlight: An Efficient and Robust Software for Automated Fusion of Multiple Preclinical Imaging Modalities

Author Spotlight: An Efficient and Robust Software for Automated Fusion of Multiple Preclinical Imaging Modalities

Published on: October 27, 2023

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers

Published on: January 18, 2020

Methods to Test Visual Attention Online

Methods to Test Visual Attention Online

Published on: February 19, 2015

The method is validated on transrectal ultrasound (TRUS) to magnetic resonance (MR) registration for prostate cancer biopsy.

Main Results:

The proposed deep neural network with the cross-modal attention block significantly outperforms advanced CNN-based networks in MR-TRUS registration.
The network demonstrates superior performance compared to existing methods, even with a smaller model size.
Visualization techniques were incorporated to enhance the interpretability of the network's operations.

Conclusions:

The novel cross-modal attention mechanism offers a powerful approach for multi-modal medical image registration.
The method provides a more efficient and interpretable deep learning solution for clinical applications like prostate cancer biopsy.
This work advances the field of deep learning for medical image analysis and registration.