Related Experiment Video
Updated: May 5, 2026

MRI and PET in Mouse Models of Myocardial Infarction
Published on: December 19, 2013
Graph-Informed and FiLM-Enhanced Multimodal Fusion for Myocardial Infarction Prediction
Abstract:
Accurate and timely diagnosis of cardiovascular diseases, particularly myocardial infarction (MI), remains a critical clinical challenge. Existing electrocardiogram (ECG) analysis methods often rely solely on asingle data modality, such as raw signals or waveform images, which limits their ability to capture thebroader physiological context. To address this limitation, we propose GFM-MIP, a Graph-informed and FiLM-enhanced Multimodal Fusion framework for myocardial infarction prediction. GFM-MIP integrates 12-lead ECG time-series signals, ECG images, and laboratory test results through a unified architecture. Specifically, it employs a Graphormer encoder to model inter-lead dependencies in ECG signals and a Vision Transformer to extract morphological patterns from ECG images, both modulated by patient-specific laboratory features using Feature-wise Linear Modulation (FiLM). A Transformer-based fusion module captures cross-modal interactions, while a contrastive learning objective encourages alignment between signal and image modalities. Experimental results on a real-world clinical dataset and three public benchmarks demonstrate that GFM-MIP consistently outperforms state-of-the-art baselines across multiple evaluation metrics. Ablation studies further validate the contribution of each modality and architectural component. The proposed framework offers a clinically meaningful and scalable solution for robust, multimodal cardiovascular diagnosis.
More Related Videos
Related Concept Videos
Imaging Studies for Cardiovascular System IV: CMRI
Imaging Studies for Cardiovascular System VI: Calcium -Scoring CT

