通过富里埃嵌入重新审视一个阶段的深度未校准光度学立体声
概括
本研究介绍了FUPS-Net,这是一款用于未校准光度立体 (UPS) 的新型一阶段深度学习网络. 它通过隐式学习使用里埃变换的照明和几何特征,准确地重建非兰伯特物体的3D形状,改进了传统的两阶段方法.
科学领域:
- 计算机视觉 计算机视觉
- 三维重建的3D重建
- 摄像度立体声 摄像度立体声
背景情况:
- 传统的非校准光度学立体 (UPS) 方法通常使用双阶段方法,将照明估计与表面正常预测分开.
- 这些双阶段网络由于不连接的训练和明确的光校准限制而遭受错误传播.
- 在非兰伯特材料中,照明和阴影之间的复杂相互作用给直接表面正常估计带来了挑战.
研究的目的:
- 为未校准光度立体 (UPS) 引入一个全新的单阶段深度学习网络,FUPS-Net.
- 克服现有的双阶段UPS方法的局限性,包括错误传播和不连接的训练.
- 为了在未知的照明条件下实现准确的非兰伯特物体3D表面重建.
主要方法:
- 开发了一级深度未校准光度学立体网络 (FUPS-Net) 使用嵌入式里埃变换.
- 介绍了里埃嵌入式提取 (FEE) 和里埃嵌入式聚合 (FEA) 块,以分解和学习里埃域中的照明和几何特征.
- 提出了一个频率空间加权 (FSW) 块,以整合频率和空间域特征,以增强表面重建.
主要成果:
- 与现有的合成和真实数据集的双阶段UPS方法相比,FUPS-Net在3D表面重建方面表现出卓越的性能.
- 一个阶段的方法提供了更好的培训稳定性和更简洁的端到端结构.
- 该方法通过隐式学习福里埃域中的特征有效地解决了几何-照明的模两可.
结论:
- FUPS-Net在基于深度学习的未校准光度学立体技术中取得了重大进展.
- 里埃域分解策略为处理非兰伯特对象提供了强大而高效的方法.
- 这项工作为未来的3D形状重建研究提供了一个有希望的新策略,使用光度立体.
相关概念视频
Continuous -time Fourier Transform
1.3K
The Fourier series is instrumental in representing periodic functions, offering a powerful method to decompose such functions into a sum of sinusoids. This technique, however, necessitates modification when applied to nonperiodic functions. Consider a pulse-train waveform consisting of a series of rectangular pulses. When these pulses have a finite period, they can be accurately represented by a Fourier series. Yet, as the period approaches infinity, resulting in a single, isolated pulse, the...
1.3K
Properties of Fourier Transform I
886
The application of Fourier Transform properties in radio broadcasting is multifaceted, enabling significant advancements in the way signals are transmitted and received. Key areas where these properties are utilized include simultaneous multi-channel transmission, audio clip speed adjustments, live broadcast delays for different time zones, audio frequency adjustments, and signal demodulation.
In radio broadcasting, multiple audio signals often need to be transmitted simultaneously. The Fourier...
In radio broadcasting, multiple audio signals often need to be transmitted simultaneously. The Fourier...
886
Properties of Fourier Transform II
1.0K
The Fourier Transform (FT) is an essential mathematical tool in signal processing, transforming a time-domain signal into its frequency-domain representation. This transformation elucidates the relationship between time and frequency domains through several properties, each revealing unique aspects of signal behavior.
The Frequency Shifting property of Fourier Transforms highlights that a shift in the frequency domain corresponds to a phase shift in the time domain. Mathematically, if x(t) has...
The Frequency Shifting property of Fourier Transforms highlights that a shift in the frequency domain corresponds to a phase shift in the time domain. Mathematically, if x(t) has...
1.0K
Discrete Fourier Transform
1.3K
The Discrete Fourier Transform (DFT) is a fundamental tool in signal processing, extending the discrete-time Fourier transform by evaluating discrete signals at uniformly spaced frequency intervals. This transformation converts a finite sequence of time-domain samples into frequency components, each representing complex sinusoids ordered by frequency. The DFT translates these sequences into the frequency domain, effectively indicating the magnitude and phase of each frequency component present...
1.3K
Fast Fourier Transform
1.3K
The Fast Fourier Transform (FFT) is a computational algorithm designed to compute the Discrete Fourier Transform (DFT) efficiently. By breaking down the calculations into smaller, manageable sections, the FFT significantly reduces the computational complexity involved. Direct computation of an N-point DFT requires N2 complex multiplications, whereas the FFT algorithm needs only (N/2)log2N multiplications, offering a much faster performance.
The computational efficiency of the FFT becomes...
The computational efficiency of the FFT becomes...
1.3K
Depth Perception and Spatial Vision
2.7K
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
2.7K


