端到端的机器人智能障碍回避方法基于深度强化学习与时空变压器架构的深度强化学习
1School of Engineering Mathematics and Technology, University of Bristol, Bristol, United Kingdom.
Frontiers in neurorobotics
|October 24, 2025
概括
本研究介绍了一个智能机器人避障系统,使用深度强化学习和变压器架构. 这种新的方法在复杂的环境中增强了自主决策,提高了安全性和效率.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
- 计算机视觉 计算机视觉
背景情况:
- 当前的机器人避障系统通常具有独立的感知和决策模块,导致数据碎片化和概括性差.
- 现有的方法在模拟动态环境和有效预测障碍轨迹方面扎.
研究的目的:
- 为机器人在复杂的动态环境中开发一个端到端的智能避障方法.
- 提高自主决策,障碍感知和政策概括能力.
主要方法:
- 集成深度Q网络 (DQN) 进行强化学习,以学习最佳的避免策略.
- 纳入时空注意力机制来模拟障碍动态和碰撞风险.
- 基于变压器的端到端架构的设计,用于使用多模式输入 (LiDAR,深度图像) 进行集成感知和决策.
主要成果:
- 与现有方法相比,拟议的方法在避免障碍的成功率,路径优化和政策趋同速度方面表现优越.
- 该系统在模拟环境中表现出良好的稳定性和概括能力.
- 消除了手动特征工程和中间状态建模的需要.
结论:
- 综合端到端的方法在机器人避难障碍方面取得了重大进展.
- 该方法显示出在复杂和动态环境中的真实应用的巨大潜力.
相关概念视频
Transformers in Distribution System
494
Transformers in distribution systems can be broadly categorized into distribution substation transformers and other distribution transformers. They are crucial for stepping down high transmission voltages to levels suitable for distribution and end-user applications.
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
494
Avoidance Learning and Learned Helplessness
2.5K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
2.5K
Transformers with Off-Nominal Turns Ratios
517
In scenarios involving parallel transformers with disparate ratings, developing per-unit models requires accommodating off-nominal turns ratios. This situation arises when the selected base voltages are not proportional to the transformer’s voltage ratings. Consider a transformer where the rated voltages are related by the term a. If the chosen voltage bases satisfy a relationship involving term b, term c is defined as the ratio of these bases. This ratio is then substituted into the...
517
Relative Motion Analysis using Rotating Axes-Problem Solving
695
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
695
Observational Learning
824
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
824
Types Of Transformers
1.4K
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
1.4K
