Related Experiment Video
Updated: Jan 9, 2026
Modeling Brain Metastases Through Intracranial Injection and Magnetic Resonance Imaging
Published on: June 7, 2020
Attention-Guided Deep Learning of Chemical Exchange Saturation Transfer Magnetic Resonance Imaging to Differentiate
Nauman Bashir Bhatti1, Dylan Young2, Wilfred W Lam3
1Department of Electrical Engineering and Computer Science, Lassonde School of Engineering, York University, Toronto, Ontario, Canada; Physical Sciences Platform, Sunnybrook Research Institute, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada.
Purpose:
Stereotactic radiosurgery (SRS) is a standard treatment for brain metastases; however, it may lead to radiation necrosis (RN). RN can be virtually indistinguishable from tumor progression (TP), which can have significant clinical implications on appropriate, time-sensitive treatment. This study investigated the effectiveness of multimodal chemical exchange saturation transfer magnetic resonance imaging (MRI), combined with T1/T2 mapping and/or conventional structural MRI, in addressing this diagnostic challenge, when analyzed through attention-guided deep learning.
Methods And Materials:
MRI data (3-dimensional amide proton transfer magnetization transfer ratio [AmideMTR], relayed nuclear Overhauser effect magnetization transfer ratio [rNOEMTR], T1 and T2 parametric maps, and postcontrast T1-weighted [T1c] and T2-weighted fluid-attenuated inversion recovery [T2-FLAIR] images) were acquired from 93 patients (230 brain metastases lesions) treated with SRS a few months prior. Lesion outcomes (TP/RN) were confirmed via histopathology and/or serial clinical imaging, including the use of perfusion imaging, over a follow-up period of at least 6 months. Data were split into training (47 patients; 184 lesions) and independent testing (46 patients; 46 lesions) sets. A 3-dimensional transformer model with 2 new attention mechanisms was developed to classify lesions using various combinations of multimodal MRI inputs.
Results:
Among dual-channel models, T1c and T2-FLAIR yielded an area under the receiver operating characteristic curve (AUC) of 0.78 ± 0.01, whereas AmideMTR and rNOEMTR maps achieved 0.76 ± 0.01. Integrating AmideMTR and rNOEMTR with either T1/T2 maps or T1c/T2-FLAIR substantially improved performance (AUC = 0.84 ± 0.02 and 0.85 ± 0.02, respectively). The highest performance (AUC = 0.87 ± 0.01) was achieved using all 6 modalities.
Conclusions:
Attention-guided deep-learning analysis of chemical exchange saturation transfer MRI shows strong potential for accurately distinguishing RN from TP, underscoring the significance of multimodal MRI inputs for post-SRS lesion evaluation.
