Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Mouse Models of Cancer Study02:43

Mouse Models of Cancer Study

Mice have long served as models for studying human biology and pathology because of their phylogenetic and physiological similarity with humans. They are also easy to maintain and breed in the laboratory, and hence, many inbred strains are now available for research. Studies on mice have contributed immeasurably to our understanding of cancer biology.
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Radiomics-based causal machine learning for exploratory treatment-effect estimation of neoadjuvant chemotherapy cycle intensity in osteosarcoma: a proof-of-concept study.

BMC medical imaging·2026
Same author

Advanced Electrolyte Materials Design for High-Energy Lithium Metal Batteries Beyond 500 Wh Kg<sup>-1</sup>.

Advanced materials (Deerfield Beach, Fla.)·2026
Same author

Multi-omics analysis of the role of muskmelon mitochondria in Si-induced resistance mechanisms.

Frontiers in plant science·2026
Same author

Author Correction: Large-scale self-supervised video foundation model for intelligent surgery.

NPJ digital medicine·2026
Same author

T2Pdecoder enables protein-centric analyses from transcriptomic data.

Nature communications·2026
Same author

Reply to the Letter to the Editor: "Artificial intelligence for post-neoadjuvant axillary prediction".

European radiology·2026
Same journal

Large-scale discovery and annotation of substructure patterns in mass spectrometry profiles.

Nature communications·2026
Same journal

Salmonella SopB suppresses post-transcriptionally regulated cytokine release to reduce early tissue inflammation and delay disease progression.

Nature communications·2026
Same journal

A human-specific microRNA controls the timing of excitatory synaptogenesis.

Nature communications·2026
Same journal

An HMA-like integrated domain in the wheat tandem kinase WTK4 recognises an RNase-like pathogen effector.

Nature communications·2026
Same journal

Learning regularities in noise engages both neural predictive activity and representational changes.

Nature communications·2026
Same journal

The H3K4 methyltransferase KMT2D is an essential cofactor for GATA1 at erythroid gene enhancers.

Nature communications·2026
See all related articles

Related Experiment Video

Updated: May 8, 2026

Automated Dissection Protocol for Tumor Enrichment in Low Tumor Content Tissues
06:44

Automated Dissection Protocol for Tumor Enrichment in Low Tumor Content Tissues

Published on: March 29, 2021

2.9K

A multimodal knowledge-enhanced whole-slide pathology foundation model.

Yingxue Xu1, Yihui Wang1, Fengtao Zhou1

  • 1Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Hong Kong SAR, China.

Nature Communications
|December 12, 2025
PubMed
Summary
This summary is machine-generated.

A new foundation model, mSTAR (Multimodal Self-TAught PRetraining), integrates pathology slides, reports, and gene data for comprehensive cancer analysis. This multimodal approach significantly improves performance over vision-only models in oncological tasks.

More Related Videos

Author Spotlight: Investigating Immune Cell Dynamics in the Tumor Microenvironment &#8212; Challenges and Innovations in Cancer Prognosis
07:32

Author Spotlight: Investigating Immune Cell Dynamics in the Tumor Microenvironment — Challenges and Innovations in Cancer Prognosis

Published on: April 12, 2024

1.9K
Introduction of an Integrated Pathology Image Management, Artificial Intelligence, and Reporting System
05:33

Introduction of an Integrated Pathology Image Management, Artificial Intelligence, and Reporting System

Published on: July 11, 2025

747

Related Experiment Videos

Last Updated: May 8, 2026

Automated Dissection Protocol for Tumor Enrichment in Low Tumor Content Tissues
06:44

Automated Dissection Protocol for Tumor Enrichment in Low Tumor Content Tissues

Published on: March 29, 2021

2.9K
Author Spotlight: Investigating Immune Cell Dynamics in the Tumor Microenvironment &#8212; Challenges and Innovations in Cancer Prognosis
07:32

Author Spotlight: Investigating Immune Cell Dynamics in the Tumor Microenvironment — Challenges and Innovations in Cancer Prognosis

Published on: April 12, 2024

1.9K
Introduction of an Integrated Pathology Image Management, Artificial Intelligence, and Reporting System
05:33

Introduction of an Integrated Pathology Image Management, Artificial Intelligence, and Reporting System

Published on: July 11, 2025

747

Area of Science:

  • Computational pathology
  • Artificial intelligence in oncology
  • Digital pathology

Background:

  • Foundation models in computational pathology face challenges integrating multimodal data (reports, gene expression) and capturing whole-slide context.
  • Current models often use vision-only or image-caption data, neglecting crucial insights from pathology reports and gene expression profiles.
  • Patch-level analysis in existing models limits the capture of comprehensive whole-slide patterns.

Purpose of the Study:

  • To introduce mSTAR (Multimodal Self-TAught PRetraining), a novel pathology foundation model designed for unified multimodal integration.
  • To incorporate pathology slides, expert-created reports, and gene expression data within a single framework.
  • To advance computational pathology by enabling both slide-level analysis and multimodal data fusion.

Main Methods:

  • Developed mSTAR, a foundation model integrating three modalities: pathology slides, expert-created reports, and gene expression data.
  • Utilized a dataset of 26,169 slide-level modality pairs across 32 cancer types, including over 116 million patch images.
  • Implemented a framework to inject multimodal whole-slide context into patch representations, enabling slide-level analysis.

Main Results:

  • mSTAR demonstrated superior performance across an oncological benchmark of 97 tasks compared to previous state-of-the-art models.
  • The model showed particular strength in molecular prediction and multimodal tasks.
  • Results indicate that multimodal integration provides greater performance improvements than simply expanding vision-only datasets.

Conclusions:

  • mSTAR effectively integrates multimodal data (slides, reports, gene expression) for enhanced computational pathology.
  • The model advances analysis from patch-level to slide-level and from single to multiple modalities.
  • Multimodal foundation models represent a significant step forward in cancer diagnostics and research.