无模型变压器框架,用于对无纹理餐具对象的6-DoF姿势估计
Jungwoo Lee1, Hyogon Kim1, Ji-Wook Kwon1
1Smart Mobility Research Center, Korea Institute of Robotics and Technology Convergence (KIRO), Pohang 37666, Republic of Korea.
Sensors (Basel, Switzerland)
|October 16, 2025
概括
这项研究引入了一种基于几何学的新方法,用于估计无纹理餐具的六度自由 (6-DoF) 姿势. 基于变压器的方法使机器人能够准确地掌握和收集餐厅设置中的物品.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 计算机视觉 计算机视觉
- 人工智能的人工智能
背景情况:
- 估计餐具的六度自由 (6-DoF) 姿势对于餐厅中的机器人操纵至关重要.
- 传统的方法难以处理没有纹理的,均的物体,如盘子和碗,阻碍了自主抓取.
- 现有的方法通常依赖于纹理线索或特定的3D模型,这并不总是适用.
研究的目的:
- 开发一个无模型和无纹理的6-DoF姿势估计框架,用于机器人餐具操纵.
- 为了克服餐厅环境中传统姿势估计方法的局限性.
- 为了使服务机器人可靠的自主抓取和收集餐具.
主要方法:
- 变压器编码器架构用于姿势估计,从深度图像中处理基于几何的特征.
- 功能包括表面顶部和边框正常,提供强大的结构前置,没有纹理.
- 该管道将对象检测/细分与预训练的视频基础模型和基于变压器的姿势预测集成在一起.
主要成果:
- 拟议的方法在10种餐具类型中实现了3.53度的平均旋转误差和13.56毫米的翻译误差.
- 在移动机器人平台上的现实世界部署证明了成功的自主识别和收集餐具.
- 这种以几何学为导向的方法在服务机器人应用中被证明是实用的.
结论:
- 这种基于新型几何学的框架有效地解决了对无纹理餐具的6-DoF构成估计的挑战.
- 这种方法提高了餐厅环境中服务机器人的能力.
- 无模型和无纹理方法为自主机器人操纵提供了一个实用的解决方案.
相关概念视频
Relative Motion Analysis using Rotating Axes-Problem Solving
695
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
695
Relative Motion Analysis using Rotating Axes
876
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
876
Kinematic Equations for Rotation
755
In mechanics, when one observes a rigid body in rotational motion with constant angular acceleration, it is possible to establish equations for its rotational kinematics. This process resembles how linear kinematics are dealt with in simpler motion studies.
For instance, imagine a point A on a rigid body engaged in circular motion. The translational velocity of this particular point can be calculated by taking the time derivatives of the displacement equation, which essentially measures the...
For instance, imagine a point A on a rigid body engaged in circular motion. The translational velocity of this particular point can be calculated by taking the time derivatives of the displacement equation, which essentially measures the...
755
Planar Rigid-Body Motion
968
Understanding the movement of a rigid body in planar motion involves recognizing that every particle within this body is traversing a path that maintains a consistent distance from a specific plane. This concept is fundamental in the study of physics and mechanical engineering, and it allows us to comprehend better how objects move in space.
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
968


