通过双重注意力进行单视图3D重建
Chenghuan Li1, Meihua Xiao1, Zehuan Li1
1Software of School, East China JiaoTong University, Nanchang, JiangXi, China.
PeerJ. Computer science
|December 9, 2024
概括
通过使用空间和道注意力,R3Davit通过整合全球和本地细节来增强单视图3D重建. 这种新的网络在合成和现实世界数据集上实现了最先进的性能.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 3D 图形 3D 图形
背景情况:
- 同时构建全球背景和本地细粒度信息对于单视图3D重建至关重要.
- 现有的变压器网络在保持线性复杂性,同时捕捉全球和本地特征方面面临挑战.
研究的目的:
- 提出一个新的网络,R3Davit,用于有效的单视图3D重建.
- 为全面的特征提取利用空间和通道维度的注意力.
- 在3D重建中提高推断速度和非线性学习能力.
主要方法:
- R3Davit网络使用基于Davit骨干的编码器,利用空间和通道注意力.
- 解码器包含一个非线性强化块,一个选择性状态空间模型块和一个上采样剩余块,避免了自我注意层.
- 选择性状态空间模型块取代了自我注意力,保持了线性复杂性.
主要成果:
- 在ShapeNet和ShapeNetChairRFC数据集上,R3Davit的性能超过了最先进的方法,实现了1%更高的IOU和2%更高的F1分数.
- 在Pix3d数据集上的实验证明了该方法在真实世界数据上的稳定性.
- 拟议的解码器设计有效地学习特征,同时保持推断速度.
结论:
- 通过有效平衡全球背景和本地细节,R3Davit在单视图3D重建方面取得了重大进展.
- 网络的架构,特别是Davit骨干和专用解码器,提供了卓越的性能和稳定性.
- 拟议的方法为单视图3D重建的准确性和效率设定了一个新的基准.
相关概念视频
01:30Three-Dimensional Force System
3.2K
In mechanical engineering, a three-dimensional force system is a system of forces acting in three dimensions, with forces applied along the x, y, and z coordinate axes. The three-dimensional force system is an important concept in mechanical engineering, as it allows engineers to understand and analyze the behavior of objects and structures in three dimensions. By understanding the forces acting on a system, engineers can design more efficient and effective mechanical systems that can withstand...
3.2K
01:11Deformation of Member under Multiple Loadings
697
When a rod is made of different materials or has various cross-sections, it must be divided into parts that meet the necessary conditions for determining the deformation. These parts are each characterized by their internal force, cross-sectional area, length, and modulus of elasticity. These parameters are then used to compute the deformation of the entire rod.
In the case of a member with a variable cross-section, the strain is not constant but depends on the position. The deformation of an...
In the case of a member with a variable cross-section, the strain is not constant but depends on the position. The deformation of an...
697