Spectral and temporal multiplexing for multispectral fluorescence and reflectance imaging using two color sensors

Area of Science:

• Medical imaging
• Optical engineering
• Biophotonics

Background:

• Fluorescence imaging is crucial for medical diagnostics, providing insights into functional, anatomical, and pathological features.
• Existing methods often face limitations in speed, spectral range, or accuracy for complex biological samples.

Purpose of the Study:

• To develop a novel, video-rate fluorescence imaging system capable of multispectral acquisition across the visible and near-infrared (NIR) spectrum.
• To achieve accurate color reproduction and high-performance fluorescence unmixing for enhanced medical visualization.

Main Methods:

• A system combining spectral and temporal multiplexing using two standard color sensors for rapid multi-channel image acquisition.
• Spectral simulation and optimization to ensure sensitivity to a wide range of fluorescent dyes.
• Development of a per-pixel metric for unmixing quality assessment and a 2D visualization method for high-dimensional data.

Main Results:

• Experimental demonstration of accurate color reproduction and robust fluorescence unmixing with a prototype system.
• The system exhibits sensitivity to visible and NIR emitting dyes without filter changes.
• High signal-to-noise ratio (SNR) for unmixed fluorescence components is achievable with optimized parameters.
• A novel metric effectively quantifies unmixing quality, and a 2D graph visualizes up to three distinct fluorescent components.

Conclusions:

• The developed fluorescence imaging system offers a significant advancement for real-time medical interventions requiring detailed spectral information.
• The method provides a sensitive and versatile tool for distinguishing and segmenting multiple fluorescent markers in complex imaging scenarios.
• This technology has the potential to improve diagnostic accuracy and guide therapeutic strategies in various medical fields.