Related Experiment Videos
A Human-Machine Interaction-Experience-Learning Algorithm for Integrated Lateral-Longitudinal Decision-Making and
Wenxuan Shen1, Cunyue Yan2, Zhaoqiang Wang1
1School of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai 201620, China.
Abstract:
Traditional reinforcement learning for autonomous driving faces challenges such as slow convergence, control instability, and limited adaptability. To address these issues, this paper proposes a hybrid decision-making framework that integrates V2X communication, human-machine interaction experience, and deep reinforcement learning. Based on the Actor-Critic architecture, the framework incorporates a human-like driving tendency network to constrain the policy search space and integrates a Kalman filter-based V2X communication anomaly handling module. The model constructs the vehicle's action space and state representation. Comparative experiments with a method lacking the driving tendency module and the hierarchical planning method DDPG-RRT* show that DDPG-HP achieves faster convergence and better scenario adaptability than these baselines. It effectively avoids static and dynamic obstacles, demonstrates anticipatory and gradual deceleration, and initiates braking 1.7 s earlier than the DDPG-RRT* method, thereby reducing collision risks and enhancing pedestrian safety. Furthermore, the communication anomaly compensation mechanism effectively improves the system's adaptability and overall robustness under unstable communication conditions.
Related Concept Videos
Decision Making
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Multi-input and Multi-variable systems
In the absence of...
Controller Configurations
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller aligns...
PD Controller: Design
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
Control Systems: Applications
In modern vehicles, control systems manage various functions to enhance performance and safety. The steering wheel and accelerator are primary inputs in a car's control system. The direction...
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...