让我们去香:超越边界框的表现,以鱼眼相机为基础的对象检测在自动驾驶
Senthil Yogamani1, Ganesh Sistu2, Patrick Denny2,3
1School of Electrical & Electronic Engineering, Technological University Dublin, D07 ADY7 Dublin, Ireland.
Sensors (Basel, Switzerland)
|June 27, 2025
概括
由于扭曲,鱼眼相机对物体的检测具有挑战性. 这项研究引入了一种新的曲线盒子表示,显著提高了自动驾驶中近距离场景周围视图传感的准确性.
科学领域:
- 计算机视觉 计算机视觉
- 机器人技术 机器人技术 机器人技术
- 自动驾驶自动驾驶的自动驾驶
背景情况:
- 对象检测对于自动驾驶至关重要,行人检测是一个成熟的领域.
- 鱼眼相机提供广角,近距离感应,但由于严重的辐射扭曲,对标准物体检测方法提出了独特的挑战.
研究的目的:
- 探索和开发用于自动驾驶中的鱼眼摄像机的有效对象表示.
- 为了解决扭曲的鱼眼图像中的传统界限框的局限性.
主要方法:
- 实施了基于YOLO (You Only Look Once) 的框架来评估WoodScape数据集上的对象表示.
- 研究了标准界限框,定向界限框,圆,通用多边形,并提出了新的曲率适应多边形和曲框.
- 整合了消失点约束和相机几何张力器,以改进扭曲适应.
主要成果:
- 曲率适应多边形比标准界限框提高了3个点的平均平均精度 (mAP).
- 拟议的曲面框表示,增强了消失点约束,超过了标准界限框3mAP和面向界限框1.6mAP.
- 通过使用相机几何张量计来进行非线性扭曲适应,实现了1.4mAP的进一步改进.
结论:
- 传统的界限框对于鱼眼相机来说是不够的,因为它们具有显著的扭曲.
- 新的曲面盒表现为鱼眼图像中对象检测提供了实用和准确的解决方案.
- 开发的方法提高了自动驾驶汽车近场传感的可靠性.
相关概念视频
Association Areas of the Cortex
6.3K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
6.3K
Depth Perception and Spatial Vision
956
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
956
Spherical Coordinates
11.0K
Spherical coordinate systems are preferred over Cartesian, polar, or cylindrical coordinates for systems with spherical symmetry. For example, to describe the surface of a sphere, Cartesian coordinates require all three coordinates. On the other hand, the spherical coordinate system requires only one parameter: the sphere's radius. As a result, the complicated mathematical calculations become simple. Spherical coordinates are used in science and engineering applications like electric and...
11.0K
Relative Motion Analysis using Rotating Axes-Problem Solving
453
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
453
Inertial Frames of Reference
7.4K
Newton’s first law is usually considered to be a statement about reference frames. It provides a method for identifying a special type of reference frame: the inertial reference frame. In principle, we can make the net force on a body zero. If its velocity relative to a given frame is constant, then that frame is said to be inertial. So, by definition, an inertial reference frame is a reference frame where Newton's first law holds valid. Newton's first law applies to objects with...
7.4K
Non-inertial Frames of Reference
6.1K
A reference frame accelerating or decelerating relative to an inertial frame is a non-inertial frame. To help understand this, consider what taking off in an airplane, turning a corner in a car, riding a merry-go-round, and the circular motion of a tropical cyclone all have in common. All these systems are accelerating, decelerating, or rotating relative to the Earth; hence, they all are non-inertial frames. All these systems exhibit inertial forces, which merely seem to arise from motion,...
6.1K


