Snapshot Compressive ToF+Spectral Imaging via Optimized Color-Coded Apertures.

Area of Science:

• Optics and Photonics
• Computational Imaging
• Computer Vision

Background:

• Compressive multispectral imaging reconstructs spectral data computationally from coded projections.
• Time-of-flight (ToF) cameras capture 2D range images, providing depth information.
• Simultaneous multispectral-color-and-depth (MS+D) imaging is increasingly demanded, often using multiple sensors or bulky setups.

Purpose of the Study:

• To develop a compact, single-aperture imaging device for simultaneous snapshot MS+D data acquisition.
• To improve upon previous bulky compressive MS+D systems by utilizing a static color-coded aperture (CCA).
• To enhance spectral sensing capabilities beyond traditional RGB+D limitations.

Main Methods:

• A novel MS+D imaging device employing a static CCA and a ToF sensor was designed.
• An optimization method for CCA design, based on blue-noise-multitoning and solved via direct-binary-search, was developed for high-quality reconstruction.
• A testbed setup was created for evaluating the system's performance.

Main Results:

• The proposed system achieves compact, snapshot MS+D imaging capabilities.
• The CCA optimization method ensures good quality recovery of spectral and depth information.
• Simulated and real-world experiments validated the system's MS+D performance on static and dynamic scenes.

Conclusions:

• The developed compact MS+D imaging device offers a promising solution for simultaneous spectral and depth capture.
• The static CCA approach combined with ToF sensing provides a more streamlined and effective MS+D imaging system.
• This technology advances the field of spectral imaging by enabling efficient acquisition of rich scene information.