基于超图的多模式表示,用于开放式的3D对象检索
IEEE transactions on pattern analysis and machine intelligence
|November 15, 2023
概括
本研究介绍了开放式3D对象检索任务和一个新的基于超图的多模式表示 (HGM^2R) 框架. 该框架有效地学习了一般化的3D对象嵌入,在未见类别上显著优于现有方法.
科学领域:
- 计算机视觉和机器学习
- 3D数据分析和检索
背景情况:
- 传统的3D对象检索 (3DOR) 在近距离设置假设下运行,由于未见的类别限制了其现实世界的适用性.
- 现有的方法往往无法学习通用的3D对象嵌入,在遇到新型对象类时阻碍了性能.
研究的目的:
- 引入和解决开放式3D对象检索任务,扩大范围超出传统的近距离设置限制.
- 提出一种新的框架,即基于超图的多模式表示 (HGM^2R),用于在开放式设置中学习强大的3D对象嵌入.
主要方法:
- 该HGM^2R框架包括两个模块:多模态3D对象嵌入 (MM3DOE) 来实现不同数据模式 (多视图,点云,voxels) 的统一嵌入,以及结构意识和不变知识学习 (SAIKL) 来实现高阶相关性.
- SAIKL使用超图模型来捕捉对象之间的复杂关系,以及用于将嵌入与典型表示对齐的内存银行,从而增强概括性.
- 正式证明证明了超图模型对数据相关性的传统图形模型的优越表示能力.
主要成果:
- 为了评估开放式3DOR.集,创建了四个新的多模式数据集 (OS-ESB-core,OS-NTU-core,OS-MN40-core,OS-ABO-core).
- 拟议的HGM^2R方法显著优于现有方法,实现了具有显著改进的最先进结果 (例如,在特定数据集上获得12.12%/12.88%的mAP收益).
- 实验结果和可视化证实了该框架在提取通用3D对象嵌入式以用于开放式检索方面的有效性.
结论:
- HGM^2R框架为具有挑战性的开放式3D对象检索任务提供了强大的解决方案.
- 该方法表现出强大的概括能力,通过多模式融合和基于超图的学习有效地处理看不见的对象类别.
相关概念视频
Collisions in Multiple Dimensions: Problem Solving
4.2K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
4.2K
Vector Algebra: Graphical Method
12.2K
Vectors can be multiplied by scalars, added to other vectors, or subtracted from other vectors. The vector sum of two (or more) vectors is called the resultant vector or, for short, the resultant.
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...
12.2K
Levels of Use of a GIS
56
Geographic Information Systems (GIS) operate across three levels of application, each representing an increasing degree of complexity: data management, analysis, and prediction. These levels reflect the expanding functionality and versatility of GIS technology in handling spatial data for diverse purposes.Data ManagementAt its foundational level, GIS serves as a tool for data management, enabling the input, storage, retrieval, and organization of spatial data. This level is often employed in...
56
Three-Dimensional Force System:Problem Solving
674
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
674
Three-Dimensional Force System
2.0K
In mechanical engineering, a three-dimensional force system is a system of forces acting in three dimensions, with forces applied along the x, y, and z coordinate axes. The three-dimensional force system is an important concept in mechanical engineering, as it allows engineers to understand and analyze the behavior of objects and structures in three dimensions. By understanding the forces acting on a system, engineers can design more efficient and effective mechanical systems that can withstand...
2.0K
Three-Compartment Open Model
241
The three-compartment open model is a pharmacokinetic model used to describe the distribution and elimination of drugs following extravascular administration. It comprises a central compartment representing the plasma and two peripheral compartments. The highly perfused peripheral compartment represents organs and tissues with a rich blood supply, such as the liver, kidneys, and lungs. The scarcely perfused peripheral compartment represents tissues with lower blood supply, such as adipose...
241


