单元前融合:单元前导向的多深度估计与多尺度几何融合
Zhiwei Lin1,2, Bohan Sun2, Zhan Zhang2
1School of Mathematics and Computational Science, Xiangtan University, Xiangtan 411105, China.
Sensors (Basel, Switzerland)
|January 28, 2026
概括
本研究介绍了MonoPrior-Fusion (MPF),这是一种用于精确3D感知的新框架. 通过整合单眼深度先验,MPF可以在具有挑战性的室内环境中改进多深度估计.
科学领域:
- 计算机视觉 计算机视觉
- 机器人技术 机器人技术 机器人技术
- 3D 感知 3D 感知
背景情况:
- 准确的3D感知对于室内机器人,增强现实和自主导航至关重要.
- 现有的多深度估计方法与具有挑战性的室内条件作斗争,例如薄弱的纹理和复杂的布局.
研究的目的:
- 开发一种新的框架,即MonoPrior-Fusion (MPF),以提高室内环境中的多深度估计.
- 为了解决由具有挑战性的室内场景特征引起的性能退化.
主要方法:
- MPF将像素智能的单眼 priors 集成到多视图匹配过程中.
- 使用基于虚拟平面的层次融合架构和几何一致性损失.
- 成本-量假设被调整为明确匹配.
主要成果:
- 在基准数据集 (ScanNetV2,7Scenes,TUM RGB-D,GMU厨房) 上,MPF显著超过了最先进的多基线.
- 该方法在未见的室内领域展示了强大的概括能力.
- 将其集成到体积融合管道中,可以获得更准确,更完整的3D重建.
结论:
- MonoPrior-Fusion (MPF) 有效地提高了室内机器人和AR应用的多深度估计.
- 该框架提供了强大而准确的3D感知,在具有挑战性的场景中优于现有方法.
- 在密集的3D重建和映射任务中,MPF显示出显著的前景.
相关概念视频
Nuclear Fusion
33.8K
The process of converting very light nuclei into heavier nuclei is also accompanied by the conversion of mass into large amounts of energy, a process called fusion. The principal source of energy in the sun is a net fusion reaction in which four hydrogen nuclei fuse and ultimately produce one helium nucleus and two positrons.
A helium nucleus has a mass that is 0.7% less than that of four hydrogen nuclei; this lost mass is converted into energy during the fusion. This reaction produces about...
A helium nucleus has a mass that is 0.7% less than that of four hydrogen nuclei; this lost mass is converted into energy during the fusion. This reaction produces about...
33.8K
Tagging and Fusion Proteins
8.4K
Proteins are involved in several cellular processes and biochemical reactions. Analyzing a specific protein of interest requires it to be isolated from the other proteins in the cell. This is achieved by overexpressing the specific gene in a suitable host to produce large quantities of the target protein. A tag or label is recombined with the gene to produce a fusion protein containing the target protein and the tag. The tags on these fusion proteins can then be used for easy detection and...
8.4K
SNAREs and Membrane Fusion
12.7K
Once a transport vesicle has recognized its target organelle, the vesicular membrane needs to fuse with the target membrane to unload the cargo. Transmembrane proteins called SNAREs present on organelle membranes and their vesicles, mediate vesicle fusion.
SNAREs exist in pairs that symmetrically interact and catalyze the fusion of the lipid bilayers in vesicle and target organelle. v-SNARE in the vesicle membrane are single polypeptide chains that bind to a complementary t-SNARE, composed of 2...
SNAREs exist in pairs that symmetrically interact and catalyze the fusion of the lipid bilayers in vesicle and target organelle. v-SNARE in the vesicle membrane are single polypeptide chains that bind to a complementary t-SNARE, composed of 2...
12.7K
Multi-input and Multi-variable systems
412
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
412
Fusion of Secretory Vesicles with the Plasma Membrane
18.9K
Proteins and neurotransmitters in secretory vesicles can be released from a cell upon vesicle docking, priming, and fusion with the plasma membrane. Vesicles are docked and primed in preparation for the quick exocytosis of their contents in response to a stimulus. The fusion process is mainly carried out by a SNAP Receptor or SNARE complex, consisting of synaptobrevin, syntaxin-1, and SNAP-25.
In 1993, Jim Rothman proposed that the antiparallel pairing of vesicular and transmembrane SNAREs, or...
In 1993, Jim Rothman proposed that the antiparallel pairing of vesicular and transmembrane SNAREs, or...
18.9K
Multi-Step Reactions
8.7K
Chemical reactions often occur in a stepwise fashion involving two or more distinct reactions taking place in a sequence. A balanced equation indicates the reacting species and the product species, but it reveals no details about how the reaction occurs at the molecular level. The reaction mechanism (or reaction path) provides details regarding the precise, step-by-step process by which a reaction occurs. Each of the steps in a reaction mechanism is called an elementary reaction. These...
8.7K


