移动机器人的自适应应急响应和动态人群导航使用深度强化学习学习
Anusha Alexander1, V N Suchir Vangaveeti2, Kalaichelvi Venkatesan1
1Department of Electrical and Electronics Engineering, Birla Institute of Technology and Science, Pilani, Dubai Campus, Dubai International Academic City, Dubai, United Arab Emirates.
Frontiers in robotics and AI
|October 27, 2025
概括
本研究介绍了一个深度强化学习框架,用于在动态人群中移动机器人导航. 双延迟深度决定性政策梯度算法在成功率和效率方面表现出卓越的表现.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 移动机器人对于复杂环境中的动态导航至关重要,例如高密度的人群和紧急情况.
- 现有的路径规划和强化学习方法难以适应现实世界的不确定性和动态障碍.
研究的目的:
- 开发和评估一个深度强化学习 (DRL) 框架,用于在动态人群环境中增强移动机器人的自主导航.
- 为了比较深度决定性政策梯度 (DDPG),双延迟深度决定性政策梯度 (TD3) 和深度Q网络 (DQN) 算法的有效性.
主要方法:
- 使用DDPG,TD3和DQN算法实现了一个DRL框架.
- 开发了一个基于上下文的状态表示,集成基于LiDAR的感知,机器人动力学和目标定向.
- 使用ROS2 Gazebo模拟与TurtleBot3平台进行了挑战性场景测试.
主要成果:
- 在成功率,路径效率和避免碰撞方面,TD3算法显著超过了DDPG和DQN.
- 拟议的上下文意识状态表示改进了导航系统的情境意识.
结论:
- 基于TD3的DRL框架为动态人群中的实时,面向紧急情况的移动机器人导航提供了强大的和可适应的解决方案.
- 该研究提供了一个可重复的,受约束意识的导航架构,适合实际应用.
相关概念视频
Rolling Resistance: Problem Solving
774
Rolling resistance, also known as rolling friction, is the force that resists the motion of a rolling object, such as a wheel, tire, or ball, when it moves over a surface. It is caused by the deformation of the object and the surface in contact with each other, as well as other factors like internal friction, hysteresis, and energy losses within the materials. Rolling resistance opposes the object's motion, requiring additional energy to overcome it and maintain movement. In practical...
774
Three-Dimensional Force System:Problem Solving
1.3K
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
1.3K
Relative Motion Analysis using Rotating Axes-Problem Solving
695
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
695


