LGMMFusion:用于增强3D物体检测的LiDAR导向的多式融合框架
Haixing Cheng1, Chengyong Liu1, Wenzhe Gu1
1China Coal Energy Research Institute Co., Ltd., Xi'an, Shaanxi Province, China.
PloS one
|September 4, 2025
概括
这项研究介绍了LGMMfusion,这是自动驾驶感知的一个新框架. 它通过更早,更有效地融合激光雷达和摄像头数据来增强小物体检测,提高准确性和稳定性.
科学领域:
- 计算机视觉
- 自动驾驶系统
- 传感器融合
背景情况:
- 小物体检测对于自动驾驶安全至关重要.
- 目前的多模融合方法通常会单独处理传感器数据,从而限制性能.
- 挑战包括稀疏的LiDAR数据和低分辨率的图像功能.
研究的目的:
- 为改进物体检测提出一个新的激光导向多式融合框架 (LGMMfusion).
- 在聚变之前加强LiDAR和摄像头数据之间的特征相关性.
- 具体解决自动驾驶中小物体检测的挑战.
主要方法:
- 利用LiDAR深度信息来指导图像的鸟视图 (BEV) 功能.
- 在BEV特征融合之前促进点云和像素之间的空间交互.
- 采用多头多尺度自我注意力和适应性交叉注意力机制来实现特征对齐.
- 通过融合增强的LiDAR BEV和图像BEV功能来进行检测.
主要成果:
- 在nuScenes验证组中,LGMMfusion获得了71. 1%的NDS和67. 3%的mAP.
- 证明了对小物体的检测有所改善.
- 展示了对大多数物体类别的增强检测准确性.
结论:
- LGMMfusion有效地增强了自动驾驶中对象检测的多模式数据融合.
- 拟议的以激光雷达为导向的方法可以提高特征表示和检测性能,特别是对于小物体.
- 这个框架为强大的感知系统提供了一个有希望的方向.
相关概念视频
02:16Light Acquisition
8.0K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
8.0K
01:18Imaging Biological Samples with Optical Microscopy
9.2K
Optical microscopy uses optic principles to provide detailed images of samples. Antonie van Leeuwenhoek designed the first compound optical microscope in the 17th century to visualize blood cells, bacteria, and yeast cells. In 1830, Joseph Jackson Lister created an essentially modern light microscope. The 20th century saw the development of microscopes with enhanced magnification and resolution.
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
9.2K
01:30Three-Dimensional Force System
3.2K
In mechanical engineering, a three-dimensional force system is a system of forces acting in three dimensions, with forces applied along the x, y, and z coordinate axes. The three-dimensional force system is an important concept in mechanical engineering, as it allows engineers to understand and analyze the behavior of objects and structures in three dimensions. By understanding the forces acting on a system, engineers can design more efficient and effective mechanical systems that can withstand...
3.2K