基于事件的视频重建使用深度空间频率展开网络
概括
这项研究引入了一个新的深度空间频率展开重建网络 (DSFURNet),用于基于事件的视频重建. 通过利用频域信息,DSFURNet有效地重建视频,克服现有的仅空间方法的局限性.
科学领域:
- 计算机视觉 计算机视觉
- 信号处理 信号处理
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 当前以事件为基础的视频重建方法与亮度和结构脱斗争,导致扭曲.
- 现有的方法通常需要计算昂贵的模型,如变压器用于非本地信息获取.
研究的目的:
- 提出一个新的网络,深度空间频率展开重建网络 (DSFURNet),用于基于事件的视频重建.
- 通过结合频域分析来解决空间域方法的局限性.
主要方法:
- 开发了一个带有三个规范化项的变量模型:亮度 (里叶振幅),结构 (里叶相) 和初始化 (事件到转换).
- 设计的空间频域近似运营商,以有效地整合本地和全球信息.
- 将优化算法展开成一个代深度网络 (DSFURNet),用于连续约束应用.
主要成果:
- DSFURNet 以较低的计算成本有效地整合了本地空间和全球频率信息.
- 代网络设计允许持续应用规范化约束,逐步提高重建的视频质量.
- 与现有方法相比,实现了网络参数的显著减少,同时提高了评估指标.
结论:
- 通过利用频率域,DSFURNet提供了一种高效和有效的解决方案,用于基于事件的视频重建.
- 拟议的方法克服了诸如曝光扭曲和与先前技术相关的计算费用等关键挑战.
- 这种方法证明了空间频率分析在推进基于事件的视觉方面的潜力.
相关概念视频
Deconvolution
764
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
764
Reconstruction of Signal using Interpolation
920
Signal processing techniques are essential for accurately converting continuous signals to digital formats and vice versa. When a continuous signal is sampled with a period T, the resulting sampled signal exhibits replicas of the original spectrum in the frequency domain, spaced at intervals equal to the sampling frequency. To handle this sampled signal, a zero-order hold method can be applied, which creates a piecewise constant signal by retaining each sample's value until the next...
920
Depth Perception and Spatial Vision
2.7K
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
2.7K


