一种基于移动机器人改进软演员关键算法的路径规划方法
Tinglong Zhao1, Ming Wang1, Qianchuan Zhao2
1School of Information and Electrical Engineering, Shandong Jianzhu University, Jinan 250101, China.
Biomimetics (Basel, Switzerland)
|October 27, 2023
概括
本研究介绍了一种增强的深度强化学习算法,用于移动机器人路径规划,改善未知的环境中的导航. 精细的算法,使用最大的和事后经验重复,克服了传统方法的局限性,以提高学习效率.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 随着机器人普及,移动机器人路径规划变得越来越重要.
- 强化学习 (RL) 使机器人能够通过互动在未知的,充满障碍的环境中导航和规划路径.
- 传统的RL方法面临着诸如激励措施不足和培训期间样本利用效率低下等挑战.
研究的目的:
- 为移动机器人路径规划提供精细的深度强化学习算法.
- 通过结合最大的来提高路径规划效率来改进软行为者-关键 (SAC) 算法.
- 解决传统RL的局限性,包括缺乏激励和样本效率低下,特别是在复杂的场景中.
主要方法:
- 开发了基于软演员-批判 (SAC) 框架的精细深度强化学习算法.
- 将最大的概念集成到SAC算法中,以改进路径规划.
- 整合了事后经验重复 (HER) 机制,通过重复使用过去的经验和解决培训效率低下问题来提高算法性能.
主要成果:
- 与模拟研究中的现有方法相比,增强的算法显示出更高的性能.
- 最大和HER的整合有效地减轻了传统RL的约束.
- 改进后的算法在学习过程中显示出更高的效率,并更好地适应复杂的路径规划情况.
结论:
- 提议的增强深度强化学习算法为移动机器人路径规划提供了更有效的解决方案.
- 最大和事后经验重复的组合显著提高了学习效率和表现.
- 这种方法为机器人提供了一个强大的方法来导航复杂和不熟悉的环境.
相关概念视频
Relative Motion Analysis using Rotating Axes-Problem Solving
407
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
407
Planar Rigid-Body Motion
452
Understanding the movement of a rigid body in planar motion involves recognizing that every particle within this body is traversing a path that maintains a consistent distance from a specific plane. This concept is fundamental in the study of physics and mechanical engineering, and it allows us to comprehend better how objects move in space.
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
452
Root-Locus Method
160
A cruise control system in a car is designed to maintain a specified speed automatically by adjusting the gas pedal. The system continuously measures the vehicle's speed and makes fine adjustments to the pedal to achieve this goal. The root locus method is particularly useful for understanding how the cruise control system's behavior changes under varying conditions, such as when the car goes uphill, downhill, or faces strong wind resistance.
This system can be represented by a block...
This system can be represented by a block...
160
Rolling Resistance: Problem Solving
352
Rolling resistance, also known as rolling friction, is the force that resists the motion of a rolling object, such as a wheel, tire, or ball, when it moves over a surface. It is caused by the deformation of the object and the surface in contact with each other, as well as other factors like internal friction, hysteresis, and energy losses within the materials. Rolling resistance opposes the object's motion, requiring additional energy to overcome it and maintain movement. In practical...
352
Three-Dimensional Force System:Problem Solving
674
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
674


