正轨:类别级6D姿势跟踪与软对应矩阵估计.
IEEE transactions on visualization and computer graphics
|March 4, 2024
概括
Corr-Track是一个新的类别级6D姿势跟踪方法,它使用直接软对应约束来准确地跟踪深度视频中的对象. 它对未见的对象表现出强大的概括能力,优于以前的方法.
科学领域:
- 计算机视觉 计算机视觉
- 机器人技术 机器人技术 机器人技术
- 机器学习 机器学习
背景情况:
- 分类级别的姿势跟踪可以在没有特定实例模型的情况下进行对象姿势估计,这对于增强现实 (AR) 和虚拟现实 (VR) 至关重要.
- 一个关键的挑战是实现神经网络的强大概括,以准确预测一个类别中以前看不见的对象的姿势.
研究的目的:
- 介绍Corr-Track,一种新的类别级6D姿势跟踪方法,旨在从深度视频流中准确地跟踪物体.
- 通过开发强大的神经网络培训方法来解决类别级姿势跟踪的泛化挑战.
主要方法:
- 使用直接软对应约束来训练神经网络,以估计来自不同的稀疏点云之间的双向软对应.
- 引入软对应矩阵,并使用直接的空间点对点对应表示.
- 提出了一种"点云扩展"战略,以减轻软函数固有的"点云收缩"问题,确保准确的形状复制.
主要成果:
- 与现有方法相比,Corr-Track 在NOCS-REAL275和Wild6D数据集上取得了更高的性能.
- 跨类别的实验证明了该方法的强大泛化能力,表明其对各种应用的潜力.
结论:
- Corr-Track提供了一个有效的解决方案,用于使用深度数据进行类别级6D姿势跟踪.
- 拟议的软对应和点云扩展策略提高了对看不见的对象的跟踪精度和概括性能.
相关概念视频
Relative Motion Analysis using Rotating Axes
460
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
460
Relative Motion Analysis using Rotating Axes-Problem Solving
402
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
402
Curvilinear Motion: Rectangular Components
454
Curvilinear motion characterizes the movement of a particle or object along a curved path, notably evident when envisioning a car navigating a winding road. If the car starts at point A, its position vector is established within a fixed frame of reference, where the ratio of the position vector to its magnitude signifies the unit vector pointing in the position vector's direction.
As the car advances, its position evolves over time. Quantifying the car's velocity involves computing the...
As the car advances, its position evolves over time. Quantifying the car's velocity involves computing the...
454
Calibration Curves: Linear Least Squares
1.3K
A calibration curve is a plot of the instrument's response against a series of known concentrations of a substance. This curve is used to set the instrument response levels, using the substance and its concentrations as standards. Alternatively, or additionally, an equation is fitted to the calibration curve plot and subsequently used to calculate the unknown concentrations of other samples reliably.
For data that follow a straight line, the standard method for fitting is the linear...
For data that follow a straight line, the standard method for fitting is the linear...
1.3K
Relative Motion Analysis using Rotating Axes - Acceleration
335
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame. The absolute velocity of point B is determined by adding the absolute velocity of point A, the relative velocity of point B in the rotating frame, and the effects caused by the angular velocity within the rotating frame.
Time differentiation is...
Time differentiation is...
335
Relative Motion Analysis - Acceleration
358
A slider-crank mechanism converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider. The movement of the slider-crank is an example of general plane motion as the fluctuating angle between the crank and the connecting rod. Consider a segment AB where point A is at the end of the slider and point B is on the diametrically opposite end to point A, on a crack. The variance in...
358


