基于改进的YOLOv5算法和RealSense深度摄像头的机器人接指导系统
Maoyong Li1, Jiqiang Huang2, Long Xue1
1Beijing Key Laboratory of Opto-Electromechanical Equipment Technology, Beijing Institute of Petrochemical Technology, Beijing, 102617, China.
Scientific reports
|December 2, 2023
概括
这项研究介绍了一种改进的YOLOv5算法,配备了RealSense深度摄像头,用于自主机器人接指导. 该系统准确地检测接槽,提高机器人的自主性和接生产率.
科学领域:
- 机器人和自动化 机器人和自动化
- 计算机视觉 计算机视觉
- 制造业 制造技术 制造技术
背景情况:
- 激光视觉传感器 (LVS) 需要人工干预来引导机器人接,从而限制了自主性和生产力.
- 现有的基于视觉的系统经常在精确的槽检测和定位方面扎.
研究的目的:
- 开发一个自主机器人接指导系统,使用改进的YOLOv5算法和RealSense深度摄像头.
- 提高槽检测准确度,提高机器人接的整体自主性和效率.
主要方法:
- 一个改进的YOLOv5算法,包含一个坐标注意 (CA) 模块,用于增强槽检测.
- 集成RealSense深度摄像机,以获取深度信息,以精确定位槽.
- 一个系统将深度摄像头数据与YOLOv5预测相结合,将机器人和火把沿着接中心线引导.
主要成果:
- 实验验证证明了拟议的机器人接引导系统的可行性.
- 在300毫米的距离上,最大引导误差为2.9毫米,在0.3至2米的距离上,百分比误差在2%以内.
- 该系统有效地将深度摄像机的大场定位精度与LVS的高精度结合起来.
结论:
- 开发的系统可以通过准确识别和跟踪槽,而无需人工干预,实现自主机器人接.
- 改进的YOLOv5和深度传感器的集成显著提高了机器人接指导的准确性和效率.
- 这种方法为自动接提供了强大的解决方案,提高了生产率并减少了对人类操作者的依赖.
相关概念视频
Relative Motion Analysis using Rotating Axes-Problem Solving
406
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
406
Three-Dimensional Force System:Problem Solving
671
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
671
Relative Motion Analysis using Rotating Axes
469
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
469
Virtual Work for a System of Connected Rigid Bodies
388
Virtual work is a powerful method used to solve problems involving several connected rigid bodies. When the system is in equilibrium, virtual work is zero. This allows the calculation of the resulting forces when a system undergoes a virtual displacement. When attempting to analyze such a system, first, use a free-body diagram, where an independent coordinate represents the configuration of the links, and mark its deflected position resulting from the positive virtual displacement.
Next,...
Next,...
388
One-Degree-of-Freedom System
491
In mechanical engineering, one-degree-of-freedom systems form the basis of a wide range of electrical and mechanical components. Using these models, engineers can predict the behavior of various parts in a larger system, which gives them insight into how different forces interact with each other.
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
491
Three-Dimensional Force System
2.0K
In mechanical engineering, a three-dimensional force system is a system of forces acting in three dimensions, with forces applied along the x, y, and z coordinate axes. The three-dimensional force system is an important concept in mechanical engineering, as it allows engineers to understand and analyze the behavior of objects and structures in three dimensions. By understanding the forces acting on a system, engineers can design more efficient and effective mechanical systems that can withstand...
2.0K


