Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: May 5, 2026

Multimodal Optical Imaging Platform for Studying Cellular Metabolism
04:47

Multimodal Optical Imaging Platform for Studying Cellular Metabolism

Published on: June 6, 2025

1.3K

MMCTNet: multimodal cross-scale transformer network for hyperspectral and LiDAR/SAR image classification.

Songpeng Gong, Uzair Aslam Bhatti, Yonis Gulzar

    Optics Express
    |May 4, 2026
    PubMed
    Summary
    This summary is machine-generated.

    Related Concept Videos

    You might also read

    Related Articles

    Articles linked to this work by shared authors, journal, and citation graph.

    Sort by
    Same author

    Interpretable graph neural networks for predicting drug activity in triple-negative breast cancer using scaffold-based splits.

    Scientific reports·2026
    Same author

    Swin-DRNet: A robust transformer framework for diabetic retinopathy screening under heterogeneous imaging conditions.

    Scientific reports·2026
    Same author

    Personality traits and motivational patterns of social media use among undergraduate medical students at King Faisal University, Saudi Arabia.

    Frontiers in psychology·2026
    Same author

    Enhancing healthcare information security through VAE-driven anomaly detection in EHR access patterns.

    Scientific reports·2026
    Same author

    Distributed denial of service detection and mitigation in software-defined networking-enabled software-defined wide area networks.

    PloS one·2026
    Same author

    ChatGPT in medical education: a cross-sectional analysis of usage, attitudes, perceptions, and practices among Saudi medical students.

    Frontiers in artificial intelligence·2026

    This study introduces a new multimodal network for complex scene classification using hyperspectral images (HSI) and LiDAR/SAR data. The proposed MMCTNet enhances feature fusion and achieves superior accuracy.

    Area of Science:

    • Remote Sensing
    • Computer Vision
    • Artificial Intelligence

    Background:

    • Multisource feature fusion is crucial for complex scene classification.
    • Hyperspectral images (HSI) and LiDAR/SAR data offer complementary information.
    • Existing methods face challenges in effectively fusing these diverse data sources.

    Purpose of the Study:

    • To propose a novel multimodal cross-scale transformer network (MMCTNet) for complex scene classification.
    • To effectively fuse HSI, LiDAR, and SAR data for improved classification performance.
    • To enhance the modeling of intra-modal spatial dependencies and cross-modal semantic complementation.

    Main Methods:

    • Developed a multimodal cross-scale transformer network (MMCTNet).
    • Incorporated a spatial self-attention (SSA) module for intra-modal feature enhancement.

    More Related Videos

    Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications
    03:31

    Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

    Published on: December 15, 2023

    1.3K

    Related Experiment Videos

    Last Updated: May 5, 2026

    Multimodal Optical Imaging Platform for Studying Cellular Metabolism
    04:47

    Multimodal Optical Imaging Platform for Studying Cellular Metabolism

    Published on: June 6, 2025

    1.3K
    Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications
    03:31

    Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

    Published on: December 15, 2023

    1.3K
  • Utilized a multiscale adaptive fusion (MSAF) module for cross-modal semantic complementation.
  • Employed a transformer encoder with cross-attention for global semantic interaction.

    • Main Results:

    • MMCTNet demonstrated superior performance on four public datasets (MUUFL, Augsburg, Berlin, 2018Houston).
    • Achieved higher overall accuracy (OA), average accuracy (AA), and Kappa coefficient compared to existing methods.
    • The proposed modules effectively enhanced feature fusion and classification accuracy.

    Conclusions:

    • MMCTNet offers an effective solution for multisource feature fusion in complex scene classification.
    • The network architecture successfully integrates HSI, LiDAR, and SAR data.
    • The approach significantly advances the state-of-the-art in remote sensing scene classification.