基于深度学习的端到端3D深度恢复从单边框模式与MSUNet++网络的MSUNet++网络
Optics express
|October 20, 2023
概括
本研究介绍了MSUNet++,这是一种深度学习方法,用于从单一边缘模式进行3D深度重建. 它实现了高精度,并保留了精细的几何细节,优于现有的技术.
科学领域:
- 计算机视觉 计算机视觉
- 3D重建的3D重建
- 机器学习 机器学习
背景情况:
- 单边缘图案分析对于3D深度重建至关重要.
- 由于信息有限,现有的方法在实现高精度和保存精细的几何细节方面面临挑战.
研究的目的:
- 提出一个基于端到端深度学习 (DL) 的方法,用于从单一边缘模式中准确的3D深度恢复.
- 为了提高重建3D形状中的几何细节和高频信号的保存.
主要方法:
- 开发了一个多级特征融合卷积神经网络 (CNN),MSUNet++.
- 离散波纹转换 (DWT) 被纳入用于预处理边缘图案以提取高频信号.
- 设计了一个新的损失函数,结合了结构相似性和边缘感知.
主要成果:
- 拟议的MSUNet++方法显示了显著增强的高频几何细节.
- 该方法有效地保持了对象的整体几何形状.
- 废除研究和概括实验证实了该方法的准确性,细节的保存性和稳定性.
结论:
- 开发的MSUNet++方法为从单边纹图案进行3D深度重建提供了强大而准确的解决方案.
- 集成DWT和专门的损失函数可以改善细形几何特征的恢复.
- 该方法在准确性和细节保存方面表现优于现有方法.
相关概念视频
Uniform Depth Channel Flow: Problem Solving
70
To calculate the flow rate for a trapezoidal channel, first, identify the bottom width, side slope, and flow depth of the channel. The cross-sectional area (A) corresponding to the depth of flow (y), channel bottom width (B), and side slope (θ) is determined by:Next, calculate the wetted perimeter, which includes the bottom width and the sloped side lengths in contact with the water. Using the values of the cross-sectional area and the wetted perimeter, determine the hydraulic radius by...
70
Uniform Depth Channel Flow
78
Uniform depth channel flow keeps fluid depth consistent along channels such as irrigation canals. In natural channels, such as rivers, approximate uniform flow is often assumed. This condition occurs when the channel’s bottom slope matches the energy slope, balancing potential energy lost from gravity with head loss due to shear stress. This balance prevents depth changes along the channel length, resulting in a steady, uniform flow.Uniform flow in open channels with a constant cross-section...
78
Depth Perception and Spatial Vision
681
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
681


