V2X-ViTv2:改进的视觉转换器,用于车辆到一切的合作感知
IEEE transactions on pattern analysis and machine intelligence
|October 14, 2024
概括
本研究介绍了V2X-ViTs,这是一个新的框架,使用车辆到一切 (V2X) 通信和变压器模型来增强自动驾驶汽车的感知. 在具有挑战性的环境中,V2X-ViTs显著提高了3D对象检测的准确性和稳定性.
科学领域:
- 自主系统 自主系统
- 计算机视觉 计算机视觉
- 通信工程 通信工程
背景情况:
- 自动驾驶汽车需要强大的感知系统来安全操作.
- 当前的感知系统在复杂和动态的环境中面临着局限性.
- 车辆到一切 (V2X) 通信为合作感知提供了潜力.
研究的目的:
- 开发一个合作感知框架,利用自动驾驶汽车的V2X通信.
- 引入针对基于V2X的感知量身定制的新型视觉转换器 (ViT) 模型.
- 为了提高自动驾驶中3D物体检测的准确性和稳定性.
主要方法:
- 拟议的V2X-ViTv1和V2X-ViTv2架构使用整体注意力和多尺度窗口自我注意模块.
- 开发了一个统一的变压器架构,以应对V2X的挑战,如异步数据和错误.
- 采用特定于V2X应用程序的先进数据增强技术.
- 利用CARLA和OpenCDA模拟器创建一个大规模的V2X感知数据集.
主要成果:
- V2X-ViTs在3D物体检测方面展示了最先进的性能.
- 该框架在恶劣和杂的现实世界和合成数据集中表现出显著的稳定性.
- 在多个路上代理商之间实现了有效的信息融合.
结论:
- 与新型变压器模型集成的V2X通信显著提高了自动驾驶汽车的感知.
- 拟议的V2X-ViTs框架为3D对象检测提供了一个强大的解决方案.
- 这种方法有望提高自动驾驶系统的安全性和可靠性.
相关概念视频
Transformers with Off-Nominal Turns Ratios
141
In scenarios involving parallel transformers with disparate ratings, developing per-unit models requires accommodating off-nominal turns ratios. This situation arises when the selected base voltages are not proportional to the transformer’s voltage ratings. Consider a transformer where the rated voltages are related by the term a. If the chosen voltage bases satisfy a relationship involving term b, term c is defined as the ratio of these bases. This ratio is then substituted into the...
141
Transformers in Distribution System
99
Transformers in distribution systems can be broadly categorized into distribution substation transformers and other distribution transformers. They are crucial for stepping down high transmission voltages to levels suitable for distribution and end-user applications.
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
99
Depth Perception and Spatial Vision
601
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
601
Vision
53.0K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.0K
Visual System
553
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
553
Types Of Transformers
951
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
951


