一个系统的解决方案,用于移动目标检测和跟踪,而只使用单眼相机
Shun Wang1, Sheng Xu1, Zhihao Ma2,3
1Guangdong Provincial Key Lab of Robotics and Intelligent System, Shenzhen Institute of Advanced Technology (SIAT), Chinese Academy of Sciences (CAS), Shenzhen 518055, China.
Sensors (Basel, Switzerland)
|July 11, 2023
概括
本研究介绍了一种用于3D移动目标检测和跟踪的2D摄像机系统. 它使用改进的光流方法和几何算法来快速准确地定位目标,即使在杂的环境中也是如此.
科学领域:
- 计算机视觉 计算机视觉
- 机器人技术 机器人技术 机器人技术
- 信号处理 信号处理
背景情况:
- 准确的3D移动目标检测和跟踪对于自主系统和监控等应用至关重要.
- 传统方法通常需要多个摄像头或复杂的传感器设置.
- 现有的基于2D的跟踪系统在深度估计和准确性方面面临挑战.
研究的目的:
- 开发一种强大的视觉目标追踪系统,能够仅使用2D摄像头进行3D定位.
- 在复杂的环境中提高移动目标检测的速度和准确性.
- 提出一种新的几何方法,从二维测量进行深度估计.
主要方法:
- 利用改进的金字塔,曲线和成本量网络 (PWC-Net) 进行高效的基于光流的检测.
- 使用集群算法将移动的目标与背景噪音隔离.
- 实现一个几何针孔成像算法与一个立体卡尔曼波器 (CKF) 结合用于3D位置估计.
主要成果:
- 拟议的系统成功地通过使用单个2D摄像头在3D空间中检测和跟踪移动的目标.
- 经过修改的PWC-Net和集群算法证明了有效地从噪音数据中提取目标.
- 几何解决方案准确计算了目标的方向,高度和深度,具有高的计算效率.
结论:
- 开发的视觉目标跟踪系统为3D移动目标定位提供了有效和计算效率高的解决方案,仅使用2D视觉输入.
- 先进的光流技术与几何估计的整合为现实世界的应用提供了一个强大的框架.
- 该方法的简单性和速度使其适合实时跟踪场景.
相关概念视频
01:29Relative Motion Analysis using Rotating Axes-Problem Solving
424
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
424
01:25Relative Motion Analysis using Rotating Axes
489
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
489