概括
这项研究引入了一种新的混合边缘图案和基于模拟的训练,用于使用边缘投影谱 (FPP) 的3D重建. 新方法在现实场景中显著提高了深度估计的准确性.
科学领域:
- 计算机视觉 计算机视觉
- 计量学 计量学 计量学
- 光学工程是指光学工程.
背景情况:
- 边缘投影造型测量 (FPP) 是3D重建的一个关键技术.
- 在FPP中基于深度学习的端到端深度估计面临准确性挑战,需要大量现实世界的培训数据.
研究的目的:
- 通过引入一种新的混合编码边缘模式,提高FPP的深度估计准确性.
- 为了使用模拟训练数据实现准确的深度估计,并弥合域差距到现实世界的应用.
- 开发一种有效的深度学习架构,用于多级特征提取和融合.
主要方法:
- 提出了一种新的混合编码边缘图案,以取代传统的周期边缘.
- 利用模拟数据进行网络培训,并使用封装阶段作为输入来处理域转移.
- 推出了MSAUNet,这是一个用于多级特征提取和融合的新网络架构.
主要成果:
- 拟议的方法在迄今为止最大的现实数据集上,与现有的四种端到端深度估计技术相比,实现了更高的性能.
- 在一个120毫米深度范围的FPP系统中,在基于模拟的训练和真实场景的推断中,获得了0.207毫米的平均绝对误差 (MAE).
- 证明了混合边缘模式和模拟到真实领域适应策略的有效性.
结论:
- 新的混合编码边缘模式和基于模拟的培训方法显著提高了FPP中的深度估计准确性.
- MSAUNet架构有效地提取和融合多尺度的特征,以进行增强的3D重建.
- 该研究为FPP深度估计提供了可行和准确的解决方案,使源代码和数据集公开可用.
相关概念视频
01:18Reducing Line Loss
524
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
524
01:10Reconstruction of Signal using Interpolation
920
Signal processing techniques are essential for accurately converting continuous signals to digital formats and vice versa. When a continuous signal is sampled with a period T, the resulting sampled signal exhibits replicas of the original spectrum in the frequency domain, spaced at intervals equal to the sampling frequency. To handle this sampled signal, a zero-order hold method can be applied, which creates a piecewise constant signal by retaining each sample's value until the next...
920
01:15Depth Perception and Spatial Vision
2.7K
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
2.7K
01:29Application of Linearization and Approximation
193
A drone flying through complex terrain often relies on more than one sensing method to estimate small changes in altitude. Along with direct measurements, air pressure provides a useful indirect indicator of vertical movement. Atmospheric pressure decreases as altitude increases, and this relationship is commonly described using an exponential model. Although accurate, converting pressure measurements into altitude values requires calculations that are too complex to perform repeatedly during...
193