Related Experiment Video
Updated: Mar 28, 2026

Modeling the Functional Network for Spatial Navigation in the Human Brain
Published on: October 13, 2023
SpatialFusion: A lightweight multimodal foundation model for pathway-informed spatial niche mapping
Josephine Yates1,2, Mitra Shavakhi2, Toni K Choueiri2
1Eric and Wendy Schmidt Center at the Broad Institute of MIT and Harvard, Cambridge, USA, 02142.
Abstract:
Foundation models enable knowledge transfer across data modalities and tasks, yet foundation models for spatial biology remain in their early stages, largely centered on encoding single-cell representations in spatial context without fully integrating transcriptomic and morphological information to delineate functional niches. Here we introduce SpatialFusion, a lightweight multimodal foundation model that identifies biologically coherent microenvironments defined by distinct pathway activation patterns rather than spatial proximity alone. SpatialFusion integrates paired histopathology, gene expression, and inferred pathway activity into a unified representation. Compared with two specialist niche-detection methods and four spatial foundation models, SpatialFusion performs competitively and consistently resolves fine-grained spatial niches with unique pathway-level signatures. Applying the model to two Visium HD cohorts uncovered a pre-malignant niche in morphologically normal mucosa adjacent to colorectal tumors and revealed distinct malignant microenvironments in non-small cell lung cancer that were predictive of tumor stage. Overall, SpatialFusion offers a versatile framework for multimodal spatial analysis, enabling the discovery of new morpho-molecular niches with significant biological and clinical relevance.
Related Concept Videos
Thematic Layering in GIS
Levels of Use of a GIS
Multicompartment Models: Overview
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
Selected Data About Geographic Locations
Introduction to GIS
GIS Software, Hardware, and Sources of GIS Data

