基于改进的近距离政策优化,对具有强大的泛化能力的无人地面车辆进行路径规划
Pengqi Sun1,2, Chunxi Yang1,2, Xiaojie Zhou1,2
1Faculty of Mechanical and Electrical Engineering, Kunming University of Science and Technology, Kunming 650500, China.
Sensors (Basel, Switzerland)
|November 14, 2023
概括
本研究介绍了无人水面车辆 (USV) 的深度强化学习方法,以改善海洋环境中的路径规划和障碍回避. 这种新的方法提高了适应性,与现有的算法相比,加速了融合.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
- 海洋工程 海洋工程
背景情况:
- 无人驾驶地面车辆 (USV) 在复杂的海洋环境中面临着路径规划和动态避难障碍的挑战.
- 现有的算法经常在部分或完全未知的海洋领域的适应性和融合速度方面扎.
研究的目的:
- 建议使用深度强化学习为USVs提供视觉感知和决策方法.
- 增强在非动态海洋环境中的USV的路径规划和动态避障能力.
主要方法:
- 一种新的深度强化学习方法,用卷积神经网络 (CNN) 取代近接政策优化 (PPO) 中的完全连接层.
- 一个端到端的学习模型,处理以USV为中心的雷达感知输入为动作输出.
- 一个闭环系统,集成环境感知和决策.
主要成果:
- 与PPO,软行为体-关键 (SAC) 和深度Q网络 (DQN) 算法相比,拟议的算法证明了更快的模型融合.
- 在部分和完全未知的海洋领域观察到改善了路径规划性能.
- 该方法在不同的海洋环境中表现出良好的适应性.
结论:
- 开发的深度强化学习方法为USV导航提供了重大进步.
- 在PPO中CNN集成增强了样本信息控制,并加速了奖励模型积累.
- 这种方法为海洋环境中自主导航的挑战提供了强大的解决方案.
相关概念视频
Controller Configurations
102
Controller configurations are crucial in a car's cruise control system because they manage speed over time to maintain a consistent pace regardless of road conditions, thereby meeting design goals. In traditional control systems, fixed-configuration design involves predetermined controller placement. System performance modifications are known as compensation.
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
102
Design Example: Alignment of a Road Line Using GIS
51
The alignment of a road line using Geographic Information Systems (GIS) is a critical process in civil engineering, combining advanced technology with practical decision-making. This methodology begins with the collection of geospatial data, including information on land cover, geomorphology, drainage patterns, slope, and contour details. Such data is typically acquired through satellite imagery and GIS tools, offering a comprehensive understanding of the terrain.Once the data is gathered, it...
51
Design Example: Identifying the Locations of Monuments in the Field Using Global Positioning System Device
55
Surveyors use Global Positioning System (GPS) technology to measure the precise location and elevation of points on Earth. In a recent survey, GPS receivers were used to determine the coordinates and elevations of two park monuments. The process involved careful mission planning, data collection, and correction to ensure accuracy. The survey began with mission planning to identify optimal satellite visibility and minimize Position Dilution of Precision (PDOP). A geodetic control point...
55
Manipulation and Analysis
28
GIS manipulation and analysis functions are vital for decision-making and planning. These activities range from data retrieval tasks, such as selecting information based on specific criteria, to advanced analytical techniques that address complex spatial problems.One critical GIS analysis method is overlaying, which combines multiple data layers to examine impacts. For example, overlaying a river-dammed lake boundary with road networks can identify affected infrastructure. Another common...
28


