Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

HisCMCL: Cross-Modal Contrastive Learning with Hierarchical Multi-Scale Fusion for Spatial Expression Prediction.

Chengju Liu1, Fangfang Zhu2, Wenwen Min1

  • 1School of Information Science and Engineering, Yunnan University, Yunnan 650500, China.

Bioinformatics (Oxford, England)
|May 29, 2026
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
Associative Learning01:27

Associative Learning

Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

SpaCross deciphers spatial structures and corrects batch effects in multi-slice spatially resolved transcriptomics.

Communications biology·2025
Same author

SpaBatch: Deep Learning-Based Cross-Slice Integration and 3D Spatial Domain Identification in Spatial Transcriptomics.

Advanced science (Weinheim, Baden-Wurttemberg, Germany)·2025
Same author

SpaICL: image-guided curriculum strategy-based graph contrastive learning for spatial transcriptomics clustering.

Briefings in bioinformatics·2025
Same author

Improving cell-type composition inference in spatial transcriptomics with SpaDAMA.

PLoS computational biology·2025
Same author

VTrans: A VAE-Based Pre-Trained Transformer Method for Microbiome Data Analysis.

Journal of computational biology : a journal of computational molecular cell biology·2025
Same author

sTPLS: identifying common and specific correlated patterns under multiple biological conditions.

Briefings in bioinformatics·2025
Same journal

OmicsTransformer: Self-Supervised Masked Consistency and Uncertainty-Aware Fusion for Robust Multi-Omics Prediction.

Bioinformatics (Oxford, England)·2026
Same journal

Computational Tool Choice Impacts CRISPR Spacer-Proto spacer Detection.

Bioinformatics (Oxford, England)·2026
Same journal

ARISE: RNA-Anchored Shared-Edge Topology and Hierarchical Fusion for Spatial Multi-Omics Integration.

Bioinformatics (Oxford, England)·2026
Same journal

Interactive exploration of biobank-scale ancestral recombination graphs with Lorax.

Bioinformatics (Oxford, England)·2026
Same journal

PepMCP: A Graph-Based Membrane Contact Probability Predictor for Membrane-Lytic Antimicrobial Peptides.

Bioinformatics (Oxford, England)·2026
Same journal

ARGscape: A modular, interactive tool for manipulation of spatiotemporal ancestral recombination graphs.

Bioinformatics (Oxford, England)·2026
See all related articles

HisCMCL, a multimodal framework, enhances spatial transcriptomics (ST) inference from pathology images by integrating multi-scale features and contrastive learning for improved gene expression alignment and clinical applicability.

Area of Science:

  • Computational Biology
  • Bioinformatics
  • Medical Imaging Analysis

Background:

  • High costs and complexity limit clinical use of spatial transcriptomics (ST).
  • Inferring ST from pathology images is a promising alternative but faces challenges in feature alignment.
  • Existing models lack multi-scale and cross-sample feature extraction, hindering generalization.

Purpose of the Study:

  • To develop a novel multimodal framework for accurate spatial transcriptomics inference from pathology images.
  • To address the limitations of single-scale modeling and improve feature alignment between image and gene expression data.
  • To enhance the clinical applicability of spatial transcriptomics through efficient inference methods.

Main Methods:

  • Proposed HisCMCL, a multimodal framework integrating multi-scale features and cross-attention.

Related Experiment Videos

  • Fused spatial location information and employed contrastive learning for effective image and transcriptomic feature alignment.
  • Evaluated the model on four public datasets to assess predictive performance.

    • Main Results:

    • HisCMCL significantly outperforms existing baseline methods in predictive performance for spatial transcriptomics inference.
    • The model demonstrates good structural consistency in identifying cancer and immune markers.
    • HisCMCL effectively delineates tumor regions, providing new insights for spatial expression inference.

    Conclusions:

    • HisCMCL offers an effective solution for inferring spatial transcriptomics from pathology images.
    • The framework's multi-scale and contrastive learning approach improves feature alignment and model generalization.
    • HisCMCL shows potential for advancing cancer research and clinical diagnostics through enhanced spatial expression analysis.