无监督降解表示学习用于图像和点云的未配对恢复
IEEE transactions on pattern analysis and machine intelligence
|October 30, 2024
概括
这项研究引入了一种新的降解表示学习方案,用于未配对的低水平视力恢复. 该方法有效地提取退化信息,使图像和点云恢复在没有配对数据的情况下实现最先进的性能.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 图像处理 图像处理
背景情况:
- 低水平视力恢复旨在从低质量 (LQ) 观测中恢复高质量 (HQ) 数据.
- 由于在现实场景中难以获得配对数据,未配对的方法正在获得引力.
- 在现实数据中,复原受到各种未知的退化模型的挑战.
研究的目的:
- 开发一种未配对修复的方法,以应对未知和多样化的退化所带来的挑战.
- 通过明确建模退化特征,从未配对的数据中实现有效的学习.
主要方法:
- 提出一种降解表示学习方案,以无监督地提取隐性降解信息.
- 引入降解感知 (DA) 卷曲,灵活适应各种降解.
- 开发用于未配对恢复的通用框架,包括图像的UnIRnet和点云的UnPRnet.
主要成果:
- 降解表示学习方案成功地提取了歧视性表示,以获得准确的降解信息.
- UnIRnet和UnPRnet在未配对的图像和点云恢复任务上分别实现了最先进的性能.
- 拟议的框架证明了从未配对的数据中学习的有效性.
结论:
- 拟议的降解表示学习方案和 DA 卷曲为未配对恢复提供了强大的解决方案.
- 该框架提供了一种适用于各种未配对修复问题的多功能方法.
- 这项工作通过从未配对的数据中实现高质量的恢复,推动了低水平视觉领域的发展.
相关概念视频
Deconvolution
137
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
137
Downsampling
133
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
133
Residuals and Least-Squares Property
7.3K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.3K
Upsampling
206
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
206
¹³C NMR: Distortionless Enhancement by Polarization Transfer (DEPT)
1.0K
When proton-coupled carbon-13 spectra are simplified by a broadband proton decoupling technique, structural information about the coupled protons is lost. Distortionless enhancement by polarization transfer (DEPT) is a technique that provides information on the number of hydrogens attached to each carbon in a molecule. While the DEPT experiment utilizes complex pulse sequences, the pulse delay and flip angle are specifically manipulated. The resulting signals have different phases depending on...
1.0K
Deformations in a Transverse Cross Section
173
When a material is subjected to uniaxial stress, it elongates or contracts in the direction of the applied force, and also undergoes changes in the perpendicular directions. This behavior is crucial for understanding how materials behave under stress and is governed by mechanical properties such as Poisson's ratio v, which measures the ratio of transverse strain to axial strain.
As the material stretches, it expands or contracts in orthogonal directions to the load. This phenomenon varies...
As the material stretches, it expands or contracts in orthogonal directions to the load. This phenomenon varies...
173


