在频率空间使用复杂值CNN的图像恢复
Zafran Hussain Shah1, Marcel Müller2, Wolfgang Hübner2
1Center for Applied Data Science, Faculty of Engineering and Mathematics, Bielefeld University of Applied Sciences and Arts, Bielefeld, Germany.
Frontiers in artificial intelligence
|October 8, 2024
概括
复杂值卷积神经网络 (CV-CNNs) 通过处理全频谱来增强图像恢复. 这些CV-CNN模型在拒绝和超级解决任务中表现优于实值网络.
科学领域:
- 计算机视觉 计算机视觉
- 深度学习 (Deep Learning) 是一种深度学习.
- 图像处理 图像处理
背景情况:
- 实值卷积神经网络 (RV-CNNs) 在空间域图像恢复方面表现出色,但在全频谱处理方面遇到了困难.
- 在RV-CNNs的光谱信息处理中的局限性可能导致纹理和结构细节的丢失.
研究的目的:
- 探索复杂值卷积神经网络 (CV-CNNs) 用于频域图像恢复.
- 解决RV-CNNs在保护光谱信息方面存在的局限性,用于诸如无声化和超分辨率等任务.
主要方法:
- 拟议的新型CV-CNN模型包含复杂值的注意门,用于频域图像无色化和超分辨率.
- 在结构化照明显微镜 (SR-SIM) 和常规图像数据集上评估模型.
主要成果:
- 与他们的RV-CNN同行相比,CV-CNN模型在拒绝和超级分辨率任务中表现出更高的性能.
- 实验结果证实,与RV-CNN相比,CV-CNN在无声化过程中更好地保留频谱.
结论:
- 基于CV-CNN的方法为频域图像恢复提供了一个有希望的深度学习方法.
- 拟议的CV-CNN模型有效地解决了光谱信息的限制,提高了图像恢复质量.
相关概念视频
Reconstruction of Signal using Interpolation
179
Signal processing techniques are essential for accurately converting continuous signals to digital formats and vice versa. When a continuous signal is sampled with a period T, the resulting sampled signal exhibits replicas of the original spectrum in the frequency domain, spaced at intervals equal to the sampling frequency. To handle this sampled signal, a zero-order hold method can be applied, which creates a piecewise constant signal by retaining each sample's value until the next...
179
Linear Approximation in Frequency Domain
88
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
88
Aliasing
122
Accurate signal sampling and reconstruction are crucial in various signal-processing applications. A time-domain signal's spectrum can be revealed using its Fourier transform. When this signal is sampled at a specific frequency, it results in multiple scaled replicas of the original spectrum in the frequency domain. The spacing of these replicas is determined by the sampling frequency.
If the sampling frequency is below the Nyquist rate, these replicas overlap, preventing the original...
If the sampling frequency is below the Nyquist rate, these replicas overlap, preventing the original...
122
Convolution Properties II
174
The important convolution properties include width, area, differentiation, and integration properties.
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
174
Upsampling
209
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
209
Convolution Properties I
140
Convolution computations can be simplified by utilizing their inherent properties.
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
140


