Related Experiment Video
Updated: Jan 13, 2026

Constructing and Visualizing Models using Mime-based Machine-learning Framework
Published on: July 22, 2025
GenoPath-MCA: Multimodal masked cross-attention between genomics and pathology for survival prediction
Kaixuan Zhang1, Shuqi Dong1, Peifeng Shi1
1Brain-Computer Interface & Brain-Inspired Intelligence Key Laboratory of Sichuan Province, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054, Sichuan, China.
Abstract:
Survival prediction using whole slide images (WSIs) and bulk genes is a key task in computational pathology, essential for automated risk assessment and personalized treatment planning. While integrating WSIs with genomic features presents challenges due to inconsistent modality granularity, semantic disparity, and the lack of personalized fusion. We propose GenoPath-MCA, a novel multimodal framework that models dense cross-modal interactions between histopathology and gene expression data. A masked co-attention mechanism aligns features across modalities, and the Multimodal Masked Cross-Attention Module (M2CAM) jointly captures high-order image-gene and gene-gene relationships for enhanced semantic fusion. To address patient-level heterogeneity, we develop a Dynamic Modality Weight Adjustment Strategy (DMWAS) that adaptively modulates fusion weights based on the discriminative relevance of each modality. Additionally, an importance-guided patch selection strategy effectively filters redundant visual inputs, reducing computational cost while preserving critical context. Experiments on public multimodal cancer survival datasets demonstrate that GenoPath-MCA significantly outperforms existing methods in terms of concordance index and robustness. Visualizations of multimodal attention maps validate the biological interpretability and clinical potential of our approach.
Related Concept Videos
Cancer Survival Analysis
Genomics
Comparing the Survival Analysis of Two or More Groups
Genome-wide Association Studies-GWAS
GWAS does not require the identification of the target gene involved in...

