Related Experiment Video
Updated: Jul 12, 2025

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography
Published on: November 30, 2022
Pediatric Brain Tissue Segmentation Using a Snapshot Hyperspectral Imaging (sHSI) Camera and Machine Learning
Naomi Kifle1, Saige Teti2, Bo Ning1
1Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Hospital, Washington, DC 20010, USA.
Abstract:
Pediatric brain tumors are the second most common type of cancer, accounting for one in four childhood cancer types. Brain tumor resection surgery remains the most common treatment option for brain cancer. While assessing tumor margins intraoperatively, surgeons must send tissue samples for biopsy, which can be time-consuming and not always accurate or helpful. Snapshot hyperspectral imaging (sHSI) cameras can capture scenes beyond the human visual spectrum and provide real-time guidance where we aim to segment healthy brain tissues from lesions on pediatric patients undergoing brain tumor resection. With the institutional research board approval, Pro00011028, 139 red-green-blue (RGB), 279 visible, and 85 infrared sHSI data were collected from four subjects with the system integrated into an operating microscope. A random forest classifier was used for data analysis. The RGB, infrared sHSI, and visible sHSI models achieved average intersection of unions (IoUs) of 0.76, 0.59, and 0.57, respectively, while the tumor segmentation achieved a specificity of 0.996, followed by the infrared HSI and visible HSI models at 0.93 and 0.91, respectively. Despite the small dataset considering pediatric cases, our research leveraged sHSI technology and successfully segmented healthy brain tissues from lesions with a high specificity during pediatric brain tumor resection procedures.
Insights
Snapshot hyperspectral imaging (sHSI) aids pediatric brain tumor surgery by distinguishing healthy tissue from tumors in real-time. This technology offers high specificity, improving surgical guidance during tumor resection.
Area of Science:
- Medical imaging
- Oncology
- Surgical technology
Background:
- Pediatric brain tumors are a significant cause of childhood cancer.
- Accurate intraoperative assessment of tumor margins is crucial but challenging.
- Current biopsy methods for margin assessment can be time-consuming and lack precision.
Purpose of the Study:
- To evaluate the efficacy of snapshot hyperspectral imaging (sHSI) for real-time segmentation of healthy brain tissue from lesions in pediatric patients undergoing tumor resection.
- To assess the performance of different sHSI spectral bands (RGB, visible, infrared) in differentiating tumor margins.
Main Methods:
- sHSI data (RGB, visible, infrared) were collected from four pediatric patients during brain tumor resection surgery using a system integrated into an operating microscope.
- A random forest classifier was employed for data analysis and tissue segmentation.
- Performance was evaluated using intersection of union (IoU) for segmentation and specificity for tumor detection.
Main Results:
- The RGB sHSI model achieved the highest average IoU (0.76).
- Tumor segmentation demonstrated high specificity, with the RGB model reaching 0.996, followed by infrared (0.93) and visible (0.91) models.
- Despite a small dataset, sHSI successfully segmented healthy tissues from lesions with high accuracy.
Conclusions:
- Snapshot hyperspectral imaging is a promising technology for real-time intraoperative guidance in pediatric brain tumor surgery.
- sHSI enables accurate differentiation between healthy brain tissue and tumors, potentially improving surgical outcomes.
- Further research with larger datasets is warranted to fully establish sHSI's role in neuro-oncology.
More Related Videos
08:49Whole-Brain Single-Cell Imaging and Analysis of Intact Neonatal Mouse Brains Using MRI, Tissue Clearing, and Light-Sheet Microscopy
Published on: August 1, 2022
04:25Author Spotlight: Bridging Gaps in Anatomy and Establishing a Foundation for Algorithmic Studies
Published on: December 15, 2023