概括
本研究介绍了一种新的平行双分支融合模型,用于无镜头相机图像重建,将基于模型的和深度神经网络的方法结合起来,以获得卓越的性能. 新方法显著提高了无镜头成像系统中的图像质量.
科学领域:
- 光学和光子学 在光学和光子学.
- 计算机视觉 计算机视觉
- 图像处理 图像处理
背景情况:
- 与传统的镜头相机相比,无镜头相机的尺寸,重量和成本都降低了.
- 图像重建是无镜头成像系统的一个关键挑战.
- 目前的主流重建方法包括基于模型的方法和数据驱动的深度神经网络 (DNN).
研究的目的:
- 调查基于模型和基于DNN的重建方法的优缺点.
- 提出一种新的并行双分支融合模型,用于增强的无镜头图像重建.
- 在模拟和现实世界无镜头相机原型中验证拟议模型的有效性.
主要方法:
- 提出了一个并行双分支融合模型,集成基于模型和数据驱动的DNN分支.
- 设计了两个融合架构,即合并融合模型和分离融合模型,后者使用注意模块进行自适应加权.
- 在数据驱动分支中引入了一个新的UNet-FC网络架构,以利用无镜头光学特性.
主要成果:
- 双分支融合模型在最先进的方法中表现出优越的性能.
- 量化改进包括公共数据集上的+2.95dB PSNR,+0.036 SSIM 和 -0.0172 LPIPS.
- 使用无镜头相机原型的实验验证证证了该方法的有效性.
结论:
- 拟议的并行双分支融合模型有效地增强了无镜头图像重建.
- 将基于模型和数据驱动的技术与新型网络架构相结合,可以显著改进.
- 该方法在现实世界无镜头成像系统中显示了实际应用.
相关概念视频
Focusing of Light in the Eye
2.9K
Light rays enter the eye through the cornea, a transparent dome-shaped tissue that is the eye's outermost layer. The cornea bends or refracts, light rays traveling to the pupil. The shape of the cornea determines how much of the light is bent and whether the image will be focused correctly on the retina at the back of the eye. Once the light has passed through both refraction layers, it converges into a single focal point onto a small area. This is where photoreceptors start transforming...
2.9K
Confocal Fluorescence Microscopy
13.4K
Confocal microscopy is an advanced microscopic technique. The prime advantage of the confocal microscope over other microscopy techniques is its ability to block the out-of-focus light from the illuminated samples using pinholes. It is widely used with fluorescence optics to obtain high-resolution, sharp contrast images. Unlike optical microscopes, confocal microscopes use a focused beam of light laser to scan the entire sample surface at different z-planes. These microscopes are, therefore,...
13.4K
Imaging Biological Samples with Optical Microscopy
4.9K
Optical microscopy uses optic principles to provide detailed images of samples. Antonie van Leeuwenhoek designed the first compound optical microscope in the 17th century to visualize blood cells, bacteria, and yeast cells. In 1830, Joseph Jackson Lister created an essentially modern light microscope. The 20th century saw the development of microscopes with enhanced magnification and resolution.
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
4.9K


