单摄像头多视图6DoF对机器人抓取的估计构成估计
Shuangjie Yuan1, Zhenpeng Ge1, Lu Yang1
1Fundamental Research Center, School of Automation Engineering, University of Electronic Science and Technology of China, Chengdu, China.
Frontiers in neurorobotics
|June 29, 2023
概括
这项研究引入了一种新的单摄像头多视图 (SCMV) 方法,用于精确的机器人物体姿势估计. 该SCMV方法使用单一的摄像机和机器人运动,超越现有方法,并实现高精度掌握任务.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 计算机视觉 计算机视觉
- 机器学习 机器学习
背景情况:
- 准确的6DoF对象姿势估计对于机器人掌握至关重要.
- 现有的多视图方法通常需要多个摄像头,增加复杂性和成本.
- 阻塞和抓手碰撞可能会降低姿势估计的准确性.
研究的目的:
- 开发一种更准确,更具成本效益的6DoF对机器人掌握的估计方法.
- 为了解决传统多视角方法的局限性.
- 用新的数据集和现实世界的实验来验证拟议的方法.
主要方法:
- 引入了一个单摄像头多视图 (SCMV) 方法,使用一个单眼摄像头和机器人操纵器运动.
- 使用SCMV方法捕获多视图RGB图像序列.
- 创建并使用T-LESS-GRASP-MV数据集进行验证.
主要成果:
- 与公开算法相比,SCMV方法实现了显著更高的6DoF构成估计准确性.
- 在真正的机器人操纵器上进行了定量实验,证实了该方法的高精度.
- 通过成功完成装配任务,以80%的成功率证明了强度.
结论:
- SCMV方法为机器人对象姿势估计提供了更简单,更准确的解决方案.
- 拟议的方法增强了机器人掌握能力.
- "T-LESS-GRASP-MV"数据集为未来在这一领域的研究提供了宝贵的资源.
更多相关视频
相关概念视频
One-Degree-of-Freedom System
519
In mechanical engineering, one-degree-of-freedom systems form the basis of a wide range of electrical and mechanical components. Using these models, engineers can predict the behavior of various parts in a larger system, which gives them insight into how different forces interact with each other.
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
519
Relative Motion Analysis using Rotating Axes-Problem Solving
425
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
425
Relative Motion Analysis using Rotating Axes
489
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
489
Kinematic Equations for Rotation
354
In mechanics, when one observes a rigid body in rotational motion with constant angular acceleration, it is possible to establish equations for its rotational kinematics. This process resembles how linear kinematics are dealt with in simpler motion studies.
For instance, imagine a point A on a rigid body engaged in circular motion. The translational velocity of this particular point can be calculated by taking the time derivatives of the displacement equation, which essentially measures the...
For instance, imagine a point A on a rigid body engaged in circular motion. The translational velocity of this particular point can be calculated by taking the time derivatives of the displacement equation, which essentially measures the...
354
Three-Dimensional Force System:Problem Solving
696
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
696
Three-Dimensional Force System
2.1K
In mechanical engineering, a three-dimensional force system is a system of forces acting in three dimensions, with forces applied along the x, y, and z coordinate axes. The three-dimensional force system is an important concept in mechanical engineering, as it allows engineers to understand and analyze the behavior of objects and structures in three dimensions. By understanding the forces acting on a system, engineers can design more efficient and effective mechanical systems that can withstand...
2.1K


