向人类水平的3D相对姿势估计:可通用,无需培训,具有单一参考
IEEE transactions on pattern analysis and machine intelligence
|August 28, 2025
概括
这项研究引入了一种新的3D可通用的相对姿势估计方法,用于看不见的物体. 没有培训的方法使用可分化的染器和语义线索,优于监督的方法.
科学领域:
- 计算机视觉
- 机器人技术
- 三维感知
背景情况:
- 人们从单个图像中直观地估计物体的姿势.
- 现有的方法通常需要大量的训练数据和对象特定的标签.
- 使用3D形状感知,染与比较以及语义线索是关键.
研究的目的:
- 提出一种新的3D可通用的相对姿势估计方法.
- 在没有预先训练或标记的情况下, 能够对未见的物体进行姿势估计.
- 通过无培训的方法改进现有的监督方法.
主要方法:
- 使用来自RGB-D参考图像的2.5D形状.
- 使用可微分染器进行染和比较模拟.
- 利用预先训练的模型 (例如,DINOv2) 的语义线索进行对应.
- 通过比较染和查询图像/语义地图来完善3D相对姿势.
主要成果:
- 拟议的方法在LineMOD,LM-O和YCB-V数据集上实现了最先进的性能.
- 与监督方法相比表现明显优异,特别是严格的准确度指标 (Acc@5/10/15°).
- 在具有挑战性的跨数据集实验中表现出强大的概括能力.
结论:
- 没有训练的,可通用的相对姿势估计方法对未见的物体有效.
- 整合2.5D形状,可分辨染和语义线索是一个有希望的方向.
- 这种方法为3D姿势估计任务提供了可靠的替代方法.
更多相关视频
06:32Author Spotlight: Automated Deep Brain Stimulation for Parkinson's Disease - Exploring the Possibilities and Challenges of Home Monitoring
Published on: July 14, 2023
1.4K
05:41A Step-by-Step Implementation of DeepBehavior, Deep Learning Toolbox for Automated Behavior Analysis
Published on: February 6, 2020
9.5K
相关概念视频
01:25Relative Motion Analysis using Rotating Axes
530
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
530
01:29Relative Motion Analysis using Rotating Axes-Problem Solving
448
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
448