Related Experiment Video
Updated: Sep 13, 2025

Multimodal Imaging and Spectroscopy Fiber-bundle Microendoscopy Platform for Non-invasive, In Vivo Tissue Analysis
Published on: October 17, 2016
Deep-learning based colorectal cancer pathological analysis with hyperspectral light field microscopy
Hao Sheng1,2, Yingying Zhang1,2, Ruixuan Cong1,2
1Key Laboratory of Data Science and Intelligent Computing, Hangzhou International Innovation Institute, Beihang University, Hangzhou 311115, China.
Abstract:
5D hyperspectral light field (H-LF) integrates multi-angular and multi-spectral observation, offering a comprehensive opportunity to capture more detailed information from biological samples. In this article, we integrate hyperspectral light field microscopy imaging to analyze H&E-stained whole slide images (WSIs) of colorectal cancer (CRC). Specifically, we design a triple separable transformer encoder (HLFTST) that efficiently extracts features by decoupling the 5D H-LF data into lower-dimensional components and applying self-attention for global interaction. We also introduce a text encoder-decoder to align H-LF features with language, enabling automatic cell classification and pathology report generation through a three-stage training pipeline. Experiments show our method outperforms 2D, 3D, and 4D baselines, improving precision by up to 4.88% and F1 score by 4.21% across five CRC cell categories. Additionally, it generates meaningful pathology descriptions, highlighting its potential for enhancing diagnostics and supporting personalized treatment in broader biomedical settings.
More Related Videos
11:27Quantitative Multispectral Analysis Following Fluorescent Tissue Transplant for Visualization of Cell Origins, Types, and Interactions
Published on: September 22, 2013
15:17Colorectal Cancer Cell Surface Protein Profiling Using an Antibody Microarray and Fluorescence Multiplexing
Published on: September 25, 2011