知识蒸增强行为转换器用于自动驾驶的决策
1College of Automotive Engineering, Jilin University, Changchun 130025, China.
Sensors (Basel, Switzerland)
|January 11, 2025
概括
本研究介绍了KD-BeT,这是一个用于自动驾驶行为决策的新框架. 它增强了强化学习 (RL),使用变压器和知识蒸来提高安全性和效率.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 自动驾驶依赖于行为决策,弥合知觉和控制.
- 模仿学习 (IL) 和强化学习 (RL) 是关键的方法,但RL在复杂的环境中面临挑战,因为推理和样本效率有限.
研究的目的:
- 提出一个创新的知识蒸增强行为转化器 (KD-BeT) 框架.
- 为了利用变压器的上下文推理来实现自动驾驶中的顺序决策.
- 提高RL在复杂的驾驶场景中的训练效率和性能.
主要方法:
- 引入了一个行为转换器作为RL的政策网络,利用观察-行动历史.
- 采用教师-学生范式:通过IL培训的教师模型,其次是知识蒸以加速RL.
- 将KD-BeT框架应用于自动驾驶行为决策.
主要成果:
- 在训练过程中,KD-BeT表现出快速的融合和高的非对称性性能.
- 在CARLA NoCrash对交通效率和驾驶安全的基准测试中超越了最先进的方法.
- 验证了知识蒸在提高自动驾驶RL方面的有效性.
结论:
- KD-BeT框架为自动驾驶行为决策提供了一种新且有效的解决方案.
- 成功地将变压器架构与知识蒸相结合,以克服RL的限制.
- 在交通效率和驾驶安全方面实现了卓越的性能,为现实世界的应用铺平了道路.
更多相关视频
06:28A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants
Published on: August 26, 2018
5.9K
11:12Driving Simulation in the Clinic: Testing Visual Exploratory Behavior in Daily Life Activities in Patients with Visual Field Defects
Published on: September 18, 2012
17.3K
相关概念视频
Decision Making
85
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
85
Controller Configurations
85
Controller configurations are crucial in a car's cruise control system because they manage speed over time to maintain a consistent pace regardless of road conditions, thereby meeting design goals. In traditional control systems, fixed-configuration design involves predetermined controller placement. System performance modifications are known as compensation.
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
85
PD Controller: Design
183
In automotive engineering, car suspension systems often employ Proportional Derivative (PD) controllers to enhance performance. PD controllers are utilized to adjust the damping force in response to road conditions. A controller, acting as an amplifier with a constant gain, demonstrates proportional control, with output directly mirroring input.
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
183
Control Systems: Applications
573
Electrical engineering plays a pivotal role in our daily lives, with control systems at the heart of many applications, from home appliances to sophisticated space shuttles. Control systems manage and regulate the behavior of devices and processes, ensuring they function safely, correctly, and efficiently.
In modern vehicles, control systems manage various functions to enhance performance and safety. The steering wheel and accelerator are primary inputs in a car's control system. The...
In modern vehicles, control systems manage various functions to enhance performance and safety. The steering wheel and accelerator are primary inputs in a car's control system. The...
573
Cognitive Learning
219
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
219
Reason and Intuition
6.3K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.3K
