自主监督的深度超分辨率与对比的多视图预训练
Xin Qiao1, Chenyang Ge1, Chaoqiang Zhao2
1Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University, Xi'an, 710049, China.
概括
本研究介绍了一种自我监督的深度超分辨率方法,使用对比的多视图预训练. 它有效地取样了没有配对数据的深度地图,优于现有的深度超分辨率技术.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 像指导深度超分辨率 (GDSR) 这样的低水平视觉任务面临挑战,因为配对训练数据有限.
- 自主监督学习提供了一个解决方案,但在没有高分辨率目标的情况下提取深度图仍然很困难.
研究的目的:
- 提出一种新的自我监督的深度超分辨率方法.
- 为了应对GDSR中不足的配对培训数据的挑战.
- 为了提高深度地图上采样的准确性和概括性.
主要方法:
- 一种自我监督的深度超分辨率方法,利用对比的多视图预训练.
- 一种可适应回归任务的策略,即使是小数据集,通过提取独特的指导特征来减少信息冗余.
- 一个新的相互调制方案,用于计算跨模态特征之间的局部空间相关性.
主要成果:
- 与最先进的GDSR技术相比,提出的方法实现了更高的性能.
- 在没有明确的高分辨率监督的情况下,展示了有效的深度地图上采样.
- 在不同的模式中表现出良好的概括能力.
结论:
- 开发的自我监督方法有效地克服了GDSR.中的数据限制.
- 对比的多视图预训练和相互调制方案增强了特征提取和空间相关性.
- 该方法显示了在推进自主监督深度估计和相关视觉任务方面具有重大潜力.
相关概念视频
Depth Perception and Spatial Vision
700
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
700
Super-resolution Fluorescence Microscopy
7.0K
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...
7.0K
Deconvolution
180
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
180
Upsampling
254
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
254


