一个基于CNN的视觉转换器用于水下图像增强ViTClarityNet
Mohamed E Fathy1, Samer A Mohamed2,3, Mohammed I Awad2
1Mechatronics Engineering Department, Faculty of Engineering, Ain Shams University, Cairo, 11535, Egypt. 2002597@eng.asu.edu.eg.
Scientific reports
|May 14, 2025
概括
本研究介绍了ViT-Clarity,这是一个使用视觉变压器和CNN的先进的水下图像增强模块. 它有效地改善了水下计算机视觉任务,如物体检测,解决了可见性差和散射的挑战.
科学领域:
- 计算机视觉 计算机视觉
- 图像处理 图像处理
- 海洋学 海洋学 海洋学
背景情况:
- 水下环境对计算机视觉提出了重大挑战,原因是光散射,吸收和光照不佳.
- 现有的方法难以有效地增强水下图像,限制了各种视觉任务的执行.
研究的目的:
- 开发和评估一个有效的水下图像增强模块,ViT-Clarity,利用视觉变换器.
- 为了解决配对的水下数据集的稀缺性,提出了一种合成数据生成方法,BlueStyleGAN.
- 在下游计算机视觉应用中展示增强水下图像的实际实用性.
主要方法:
- 介绍了ViT-Clarity,这是一个水下图像增强模块,将视觉变压器 (ViT) 与卷积神经网络 (CNN) 集成在一起.
- 开发了BlueStyleGAN,一个生成对抗网络 (GAN),从清晰的空中图像中创建现实的合成水下图像.
- 在使用定量 (UCIQM, UCIQE, URanker) 和定性指标的五个不同的水下数据集上评估了ViT-ClarityNet,并将其与最先进的方法和无变压器变体 (ClarityNet) 进行比较.
主要成果:
- 与现有方法和Clarity.Net相比,ViT-ClarityNet在水下图像增强方面表现出卓越的性能.
- BlueStyleGAN在生成现实的合成水下图像方面被证明是有效的,显示出良好的训练稳定性.
- 来自ViT-Clarity的增强图像显著提高了对象检测和SIFT特征匹配任务的性能.
结论:
- ViT-Clarity为水下图像增强提供了强大的解决方案,显著提高了可见性,并使计算机视觉更有效.
- 视觉变压器的集成对于在水下图像恢复中实现最先进的性能至关重要.
- 拟议的BlueStyleGAN解决了数据稀缺问题,促进了水下视觉的进一步研究和开发.
相关概念视频
Vision
48.7K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
48.7K
Deconvolution
776
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
776
Uniform Depth Channel Flow
890
Uniform depth channel flow keeps fluid depth consistent along channels such as irrigation canals. In natural channels, such as rivers, approximate uniform flow is often assumed. This condition occurs when the channel’s bottom slope matches the energy slope, balancing potential energy lost from gravity with head loss due to shear stress. This balance prevents depth changes along the channel length, resulting in a steady, uniform flow.Uniform flow in open channels with a constant...
890


