从NIR单像素成像中获得的图像的深度学习模糊校正
概括
这项研究引入了一种新的近红外 (NIR) 成像系统,使用单像素成像 (SPI) 和飞行时间来改善雨中的可见性. 扩散模型可以提高图像质量,以应对户外环境的挑战.
科学领域:
- 光学和光子学 在光学和光子学.
- 计算机视觉 计算机视觉
- 遥感 遥感 遥感 遥感
背景情况:
- 传统相机在低光和散射条件下 (雨,雾,烟雾) 难以工作,降低了可见度.
- 近红外 (NIR) 光 (850-1550 nm) 提供了减少的散射,在不利条件下改善成像.
- 现有的NIR摄像头通常是昂贵的,需要替代解决方案.
研究的目的:
- 开发和评估一个具有成本效益的视觉系统,用于在具有挑战性的户外环境中增强成像,特别是针对雨天条件.
- 将NIR主动照明单像素成像 (SPI) 与飞行时间 (ToF) 结合起来,用于2D图像重建.
- 利用扩散模型来提高重建的NIR-SPI图像的质量.
主要方法:
- 提出了一个视觉系统,将1550nm NIR主动照明SPI与850nm飞行时间 (ToF) 集成为2D图像重建.
- 集成的扩散模型来提高NIR-SPI图像的质量.
- 模拟室外实验室条件,背景照明和滴滴大小各不相同,以评估系统性能.
主要成果:
- 展示了拟议的NIR-SPI和ToF系统的可行性,用于在模拟的雨水条件下进行2D图像重建.
- 展示了扩散模型在提高NIR-SPI图像清晰度和对比度方面的有效性.
- 在不同的环境参数下评估系统的性能,包括滴滴大小和背景光.
结论:
- 拟议的NIR-SPI系统与ToF和扩散模型相结合,显示出作为低可见度成像的可行和潜在的成本效益解决方案的承诺.
- 这种方法为克服在恶劣天气条件下传统摄像机的局限性提供了一条途径.
- 进一步的研究可以探索现实世界的部署和优化各种具有挑战性的环境.
相关概念视频
Imaging Biological Samples with Optical Microscopy
4.8K
Optical microscopy uses optic principles to provide detailed images of samples. Antonie van Leeuwenhoek designed the first compound optical microscope in the 17th century to visualize blood cells, bacteria, and yeast cells. In 1830, Joseph Jackson Lister created an essentially modern light microscope. The 20th century saw the development of microscopes with enhanced magnification and resolution.
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
4.8K
Light Acquisition
8.5K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
8.5K
Focusing of Light in the Eye
2.9K
Light rays enter the eye through the cornea, a transparent dome-shaped tissue that is the eye's outermost layer. The cornea bends or refracts, light rays traveling to the pupil. The shape of the cornea determines how much of the light is bent and whether the image will be focused correctly on the retina at the back of the eye. Once the light has passed through both refraction layers, it converges into a single focal point onto a small area. This is where photoreceptors start transforming...
2.9K
Super-resolution Fluorescence Microscopy
7.0K
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...
7.0K
Deconvolution
186
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
186


