从RGB图像与深 convolutional神经网络的可见和NIR微观超频谱重建
Optics express
|February 1, 2024
概括
这项研究引入了深度卷积神经网络 (DCNN) 来从RGB图像中进行微观超光谱重建,比传统方法提高了性能. 该模型显示了将重建扩展到红外波段的潜力.
科学领域:
- 显微镜的使用方法
- 计算成像技术的成像
- 频谱学是一种光谱学.
背景情况:
- 超光谱成像可以捕获详细的光谱信息,但通常是复杂和昂贵的.
- 从标准RGB图像中重建超光谱图像提供了一个更容易获得的方法.
- 微观超光谱成像由于尺度和光谱相关性而存在独特的挑战.
研究的目的:
- 开发和评估一个深度卷积神经网络 (DCNN) 从RGB图像进行微观超光谱重建.
- 用3D卷积和加权损失函数来研究光谱相关性的影响.
- 评估模型在公共和定制显微数据集上的性能,并探索其扩展到红外区域.
主要方法:
- 采用了DCNN框架,用3D卷积取代2D卷积,以利用光谱相关性.
- 构建了一个微观超光谱和RGB图像对的自制数据集.
- 在损失函数中引入了一个重量因子,以增强重建的超频谱评估.
主要成果:
- 拟议的DCNN模型与传统的DCNN模型相比,在超光谱重建方面表现出更高的性能.
- 该研究分析了卷积内核尺寸和重量因子对模型性能的影响.
- 该模型显示了从可见到近红外频段扩展超频谱重建的有希望的结果.
结论:
- 开发的DCNN模型有效地从RGB数据中重建微观的超光谱图像.
- 使用3D卷积和加权损失函数显著提高了重建的准确性.
- 这种方法有可能在光谱成像中得到更广泛的应用,包括红外光谱.
相关概念视频
01:24Color Vision
580
Color perception begins in the retina, the light-sensitive layer at the back of the eye. Two main theories explain how colors are seen: the trichromatic theory and the opponent-process theory. The trichromatic theory, proposed by Thomas Young in 1802 and extended by Hermann von Helmholtz in 1852, suggests that color vision is based on three types of cone receptors in the retina. These cones are sensitive to different but overlapping ranges of wavelengths corresponding to red, blue, and green.
580
01:02Ultraviolet and Visible (UV–Vis) Spectroscopy: Overview
2.6K
Ultraviolet–visible (UV–visible or UV–Vis) spectroscopy is an analytical technique that investigates the interaction between matter and UV–Vis light within the electromagnetic spectrum. This method is widely used for its versatility, simplicity, and relatively quick data acquisition, making it valuable for both qualitative and quantitative analysis. When UV–Vis radiation passes through a material, molecules absorb light depending on the energy required for...
2.6K
01:22Photoreceptors and Visual Pathways
6.0K
At the molecular level, visual signals trigger transformations in photopigment molecules, resulting in changes in the photoreceptor cell's membrane potential. The photon's energy level is denoted by its wavelength, with each specific wavelength of visible light associated with a distinct color. The spectral range of visible light, classified as electromagnetic radiation, spans from 380 to 720 nm. Electromagnetic radiation wavelengths exceeding 720 nm fall under the infrared category,...
6.0K