在非结构化地形上使用深度强化学习来规划腿类机器人的自适应运动计划.
1Computer Science and Engineering Department, East West University, Aftabnagar, Dhaka, 1212, Badda, Bangladesh. uddin@ewubd.edu.
Scientific reports
|January 6, 2026
概括
这项研究介绍了使用深度强化学习 (DRL) 训练的四足机器人适应性运动框架. 该系统可以在具有挑战性的地形上实现稳定,节能步行,脚部滑动最小,增强机器人的移动性.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
- 控制系统 控制系统
背景情况:
- 与轮式平台相比,双腿机器人在非结构化地形上提供了优越的移动性.
- 由于地面不稳定,传感有限,以及动态的身体运动,脚型机器人的运动规划是复杂的.
- 经典的控制方法与地形和摩擦不可预测的变化作斗争.
研究的目的:
- 为能够在多样化和不可预测的环境中导航的四足机器人开发适应性机动框架.
- 使用深度强化学习 (DRL) 训练控制器,以适应不同的地形条件和动态.
- 确保学习的机动政策在不同的模拟环境中是稳健的和可通用的.
主要方法:
- 一个深度强化学习 (DRL) 控制器使用近接政策优化 (PPO) 方法完全在模拟 (Webots) 中接受了培训.
- 培训采用了一个课程机制,从平坦的地形开始,逐渐引入斜坡,粗的表面和摩擦变化.
- 控制器学会了根据关节状态,身体姿势和当地地形高度来选择立足点,调节身体姿势,并最大限度地减少滑动,而没有明确的地形标签.
主要成果:
- 训练有素的控制器表现出新出现的行为,例如在斜坡上更宽的立场和在岩石上增加的步骤高度,以提高稳定性.
- 该框架在没有重新训练的情况下实现了高成功率 (94.6%的Webots,PyBullet的91.2%),并在1.6秒内从外部干扰中恢复.
- 该系统学会了稳定,节能地移动,在一系列摩擦系数中脚的滑动最小.
结论:
- 拟议的自适应运动框架有效地使四足机器人能够在具有挑战性的,非结构化的地形上导航.
- 深度强化学习为腿类机器人提供了一种可行的训练方法,用于训练强大和可适应的移动政策.
- 学习的行为增强了机器人的稳定性,能源效率和弹性,为搜救和勘探中的应用铺平了道路.
相关概念视频
Planar Rigid-Body Motion
966
Understanding the movement of a rigid body in planar motion involves recognizing that every particle within this body is traversing a path that maintains a consistent distance from a specific plane. This concept is fundamental in the study of physics and mechanical engineering, and it allows us to comprehend better how objects move in space.
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
966
Rolling Resistance: Problem Solving
773
Rolling resistance, also known as rolling friction, is the force that resists the motion of a rolling object, such as a wheel, tire, or ball, when it moves over a surface. It is caused by the deformation of the object and the surface in contact with each other, as well as other factors like internal friction, hysteresis, and energy losses within the materials. Rolling resistance opposes the object's motion, requiring additional energy to overcome it and maintain movement. In practical...
773
Relative Motion Analysis using Rotating Axes-Problem Solving
693
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
693
Absolute Motion Analysis- General Plane Motion
527
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
527


