Related Experiment Video
Updated: Jan 14, 2026

Constructing and Visualizing Models using Mime-based Machine-learning Framework
Published on: July 22, 2025
M3Surv: Fusing Multi-slide and Multi-omics for Memory-augmented robust Survival prediction
Mingcheng Qu1, Guang Yang1, Donglin Di2
1Faculty of Computing, Harbin Institute of Technology, Harbin, China.
Abstract:
Multimodal survival prediction is crucial for personalized oncology. However, existing methods typically integrate only Formalin-Fixed Paraffin-Embedded (FFPE) slides with a single omics type, such as genomics, overlooking Fresh Frozen (FF) slides that better preserve molecular information, as well as richer multi-omics data like proteomics and transcriptomics. More critically, the complete absence of certain modalities due to clinical constraints (e.g., time or cost) severely limits the applicability of conventional fusion models that rely on inter-modality correlations. To address these gaps, we propose M3Surv, a framework designed to integrate multi-pathology slides (both FF and FFPE) with multi-omics profiles. For multi-slide fusion, we design a divide-and-conquer hypergraph learning approach to capture both intra-slide higher-order cellular structures and inter-slide relationships, yielding a unified pathology representation. To enrich the biological context, we integrate multi-omics data and employ interactive cross-attention to fuse the pathological and omics modalities. To tackle the missing modality, we introduce a prototype-based memory bank. During training, this memory bank learns and stores representative pathology-omics feature prototypes. At inference, even if a modality is entirely missing, the model can query the bank with available features and robustly impute information from the most similar prototype. Extensive experiments on five TCGA cancer datasets and an in-house dataset demonstrate that M3Surv outperforms state-of-the-art methods, achieving an average 2.2% improvement in C-Index. The framework also shows strong stability across various missing modality scenarios, highlighting its clinical potential in real-world, data-incomplete scenarios.
Insights
M³Surv integrates multi-pathology slides (Fresh Frozen and Formalin-Fixed Paraffin-Embedded) with multi-omics data for improved cancer survival prediction. The framework robustly handles missing data, outperforming existing methods.
Area of Science:
- Computational biology
- Biomedical informatics
- Cancer research
Background:
- Personalized oncology relies on multimodal survival prediction.
- Current methods often use only FFPE slides and single omics, neglecting FF slides and multi-omics data.
- Missing data due to clinical constraints limits conventional fusion models.
Purpose of the Study:
- To develop a framework, M³Surv, for integrating multi-pathology slides (FF and FFPE) with multi-omics data.
- To address the challenge of missing modalities in survival prediction models.
- To enhance the accuracy and applicability of cancer survival prediction.
Main Methods:
- Utilized a divide-and-conquer hypergraph learning for multi-slide fusion, capturing intra- and inter-slide relationships.
- Integrated multi-omics data (proteomics, transcriptomics) with pathology features using interactive cross-attention.
- Introduced a prototype-based memory bank to impute missing modalities during inference.
Main Results:
- M³Surv achieved an average 2.2% improvement in C-Index across five TCGA cancer datasets and an in-house dataset.
- Demonstrated superior performance compared to state-of-the-art survival prediction methods.
- Showcased strong stability and robustness in scenarios with missing data modalities.
Conclusions:
- M³Surv effectively integrates diverse data types for multimodal survival prediction.
- The framework's ability to handle missing data enhances its clinical applicability.
- M³Surv offers a promising approach for data-incomplete cancer survival prediction.
More Related Videos
09:47Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches
Published on: December 15, 2023
08:51Author Spotlight: Integrated Multi-Omics Analysis for Unveiling Multicellular Immune Signatures in Clinical Heart Attack Cohorts
Published on: September 20, 2024
Related Concept Videos
Cancer Survival Analysis
Assumptions of Survival Analysis
Comparing the Survival Analysis of Two or More Groups
Kaplan-Meier Approach
Introduction To Survival Analysis
The primary goal of survival analysis is to estimate survival time—the time...
Improving Translational Accuracy