适应性多属性场景LoRA合并用于自动驾驶中的强大的感知.
Ryosuke Kawata1, Joonho Lee1, Yanlei Gu2
1Graduate School of Interdisciplinary Information Studies, The University of Tokyo, Tokyo 113-0033, Japan.
Sensors (Basel, Switzerland)
|February 27, 2026
概括
自动驾驶感知模型在不利条件下扎. 我们的参数有效微调 (PEFT) 框架使用适应性低级适应 (LoRA) 专家来提高在具有挑战性的联合天气照明场景中的性能.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 自主系统 自主系统
背景情况:
- 自动驾驶感知模型主要是通过清晰的白天数据进行训练.
- 在罕见的条件下,性能显著降低,特别是天气和照明的组合 (例如,夜晚 × 雨天).
- 这种限制对强大的现实世界部署构成了挑战.
研究的目的:
- 为自动驾驶感知模型开发一个参数效率微调 (PEFT) 框架.
- 在多样化和具有挑战性的环境条件下提高模型性能,特别是联合天气照明场景.
- 为了使模型组件根据遇到的条件进行动态适应.
主要方法:
- 提出了一个PEFT框架,利用动态应用,轻量级,场景特定的低级适应 (LoRA) 专家.
- 实施了适应管道,根据环境线索选择合适的LoRA专家.
- 通过统一的语义细分基准 (MUSES,BDD100K,城市景观) 在六个昼夜×天气场景中验证了方法.
主要成果:
- 在单个属性设置中,在强大的基线上取得了高达323万IOU点的改进.
- 在数据稀缺的多重属性场景中,合并的LoRA专家的表现高于基线的5.99点.
- 在复杂的环境条件下表现出有效的概括和适应能力.
结论:
- 拟议的PEFT框架与自适应的LoRA专家显著提高了自动驾驶的感知.
- 该方法有效地解决了在具有挑战性的联合天气照明条件下的性能限制.
- 这种方法提供了一个参数效率高的解决方案,用于在各种现实场景中提高模型的稳定性和概括性.
相关概念视频
Collisions in Multiple Dimensions: Problem Solving
5.6K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
5.6K
Multi-input and Multi-variable systems
441
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
441
Schemas
12.5K
A schema is a mental construct consisting of a cluster or collection of related concepts (Bartlett, 1932). There are many different types of schemata, and they all have one thing in common: schemata are a method of organizing information that allows the brain to work more efficiently. When a schema is activated, the brain makes immediate assumptions about the person or object being observed.
12.5K
Associative Learning
1.6K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.6K
Collisions in Multiple Dimensions: Introduction
7.1K
It is far more common for collisions to occur in two dimensions; that is, the initial velocity vectors are neither parallel nor antiparallel to each other. Let's see what complications arise from this. The first idea is that momentum is a vector. Like all vectors, it can be expressed as a sum of perpendicular components (usually, though not always, an x-component and a y-component, and a z-component if necessary). Thus, when the statement of conservation of momentum is written for a...
7.1K
Automatic Processing and Automatic Social Behavior
284
Automatic processing refers to the cognitive operations that occur without conscious intent or awareness, playing a fundamental role in shaping social cognition and behavior. These processes enable individuals to navigate complex social environments efficiently by relying on mental shortcuts and pre-existing knowledge structures known as schemas. One of the most influential mechanisms underlying automatic processing is priming, which subtly activates mental representations through exposure to...
284
