Related Experiment Video
Updated: Apr 25, 2026

Applying Hyperspectral Reflectance Imaging to Investigate the Palettes and the Techniques of Painters
Published on: June 18, 2021
Three-band SWIR imaging for Pix2Pix-based colorization
Abstract:
The short-wave infrared imaging (SWIR) is indispensable in remote sensing due to its superior capability to penetrate atmospheric scattering and capture unique material reflectance signatures. However, SWIR imagery is typically acquired as single-channel grayscale data, suffering from a complete absence of chromatic information, which severely limits human interpretability and scene analysis. While deep learning-based methods have emerged to reconstruct visible colors from infrared inputs, they fundamentally struggle with mapping uncertainty arising from spectral ambiguity-where distinct materials manifest as identical grayscale intensities, rendering the inverse problem ill-posed. To resolve this bottleneck, we propose a physics-data dual-driven band selection framework integrated with a Pix2Pix network. The proposed framework consists of three stages: physical pre-selection based on atmospheric windows and material reflectance, statistical coarse-ranking utilizing a modified optimum index factor to minimize redundancy, and fine-grained task-driven generative evaluation. We identified a globally optimal three-band combination (1000-1050, 1050-1100, and 1525-1575 nm) that maximizes input discriminability, and employing a ResNet-based generator to filter radiometric noise, we effectively decouple mapping ambiguities. Experimental results demonstrate that this method significantly outperforms standard approaches. Specifically, our method improves the PSNR by 8.63%, the SSIM by 18.87%, and optimizes the perceptual metric LPIPS by 31.28% compared to the single-band U-Net baseline.
More Related Videos
Related Concept Videos
Infrared (IR) Spectroscopy: Overview
Different compounds display unique properties due to their...
IR Spectrometers
IR Frequency Region: X–H Stretching
Imaging Biological Samples with Optical Microscopy
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...

