在二维网格上进行数据预测的抽象卷积:将空间和频率域与图像外绘和压缩传感中的应用联系起来
IEEE transactions on neural networks and learning systems
|August 22, 2025
概括
本研究引入了一个外加卷积 (EC) 框架,以改进图像恢复和压缩传感的深度学习外加值. 欧盟框架可以提高模型预测的性能,超越传统的图像绘制和压缩感应MRI.
科学领域:
- 机器学习
- 深度学习
- 图像处理
- 医学成像
背景情况:
- 卷积神经网络 (CNN) 在训练数据之外的推断任务中扎.
- 传统的CNN依赖于插值, 限制它们在图像恢复和压缩传感中预测未见数据的能力.
- 现有方法在准确重建图像和保存细节时面临挑战,因为它们与训练条件有很大差异.
研究的目的:
- 解决CNN在图像恢复和压缩传感方面的局限性.
- 提出和评估一个超值卷积 (EC) 框架,以改善超越培训约束的预测.
- 为了提高图像重建质量和图像外涂和压缩感应MRI的细节保存.
主要方法:
- 在深度学习架构中开发了一个外推卷积 (EC) 框架,将缺失的数据预测模型作为线性外推问题.
- 在编码器-解码器 (EnDec) 网络中应用EC用于图像外涂,取代传统的插值.
- 将EC集成到基于富里埃的压缩感应MRI (CS-MRI) 中,用于从低采样测量中预测高频信号.
主要成果:
- 拟议的EC-DecNet和FDRN模型与传统的基于CNN的模型相比显示出更高的性能.
- 通过更好的PSNR,SSIM,KID和FID得分来证明,实现了高质量的图像重建.
- 在高加速系数的CS-MRI中,EC有效地减少了图像超绘和保存微妙的结构细节.
结论:
- 抽象卷积 (EC) 框架显著提高了深度学习模型在抽象任务中的性能.
- EC提供了强大的图像恢复和压缩传感解决方案,特别是在训练数据有限或显著偏差的场景中.
- 对更大的内核大小和多层次半监督学习的进一步研究可以进一步优化像CS-MRI这样的频域应用中的抽象精度.
相关概念视频
Convolution: Math, Graphics, and Discrete Signals
399
In any LTI (Linear Time-Invariant) system, the convolution of two signals is denoted using a convolution operator, assuming all initial conditions are zero. The convolution integral can be divided into two parts: the zero-input or natural response and the zero-state or forced response, with t0 indicating the initial time.
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
399
Upsampling
309
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
309
Convolution Properties II
281
The important convolution properties include width, area, differentiation, and integration properties.
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
281
Convolution Properties I
236
Convolution computations can be simplified by utilizing their inherent properties.
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
236
End Point Prediction: Gran Plot
581
A Gran plot is used to predict the equivalence volume or endpoint of a potentiometric or acid-base titration without reaching the endpoint. Typically, titration data is collected as a function of the titrant's volume up to a point less than the equivalence volume and then transformed into a linear format. The straight line is extended to the x-axis, indicating the necessary titrant volume to achieve the equivalence point.
For potentiometric titration, the Gran plot is created by plotting...
For potentiometric titration, the Gran plot is created by plotting...
581
Linear Approximation in Frequency Domain
131
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
131


