基于交叉摄像机的车辆搜索任务的分阶段特征提取网络,用于车辆和道路协作感知
Hai Wang1, Yaqing Niu1, Long Chen2
1School of Automotive and Traffic Engineering, Jiangsu University, Zhenjiang 212013, China.
Sensors (Basel, Switzerland)
|October 28, 2023
概括
车辆搜索,将检测和重新识别 (Re-ID) 结合起来,对于自动驾驶至关重要. 一个新的分阶段特征提取网络 (PFE-Net) 在DAIR-V2XSearch数据集上显著提高了跨摄像头车辆搜索的准确性.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 自主系统 自主系统
背景情况:
- 车辆搜索集成了车辆检测和重新识别 (Re-ID) 以进行现实世界的图像分析.
- 现有的网络通常是为行人搜索而设计的,因此需要适应车辆特定的挑战,例如视角变化.
- 利用DAIR-V2X数据集创建了DAIR-V2XSearch,这是第一个用于车辆搜索的跨摄像头数据集.
研究的目的:
- 开发一个强大的网络跨摄像头车辆搜索,解决现有方法的局限性.
- 在现实世界驾驶场景中克服各种视角和成像条件所带来的挑战.
- 通过使用新的DAIR-V2XSearch数据集,建立车辆搜索性能的基准.
主要方法:
- 提出了一个阶段性特征提取网络 (PFE-Net),利用无YOLOX框架作为骨干.
- 在Re-ID分支中引入了摄像头分组模块,以处理视角和摄像头差异.
- 实现了一个跨层次的特征融合模块,以增强微妙的特征提取和Re-ID精度.
主要成果:
- 在DAIR-V2XSearch数据集上,PFE-Net表现出卓越的性能.
- 无方法减轻了每个车辆ID.多个箱的问题.
- 摄像机分组和功能融合模块有效地解决了跨摄像机的挑战.
结论:
- PFE-Net为跨摄像头的车辆搜索任务提供了显著的进步.
- 拟议的方法提高了复杂环境中的车辆重新识别的准确性和稳定性.
- 这项工作为智能驾驶和自动驾驶汽车的感知系统改进奠定了基础.
相关概念视频
01:20Parallel Processing
159
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
159
01:15Depth Perception and Spatial Vision
681
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
681
01:26Visual System
594
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
594
01:24Vision
53.5K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.5K
01:21Association Areas of the Cortex
5.4K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.4K
02:16Light Acquisition
8.5K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
8.5K