蒙特卡罗树搜索带有光谱扩展,用于使用动态系统进行规划
Benjamin Rivière1, John Lathrop1, Soon-Jo Chung1
1Division of Engineering and Applied Science, California Institute of Technology, Pasadena, CA 91125, USA.
光谱扩展树搜索 (SETS) 使机器人能够在连续环境中执行复杂的实时规划. 这种新的算法克服了传统方法的局限性,允许在没有专门培训的情况下发现适应性行为.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
- 控制理论 控制理论
背景情况:
- 机器人需要复杂任务的复杂规划,通常依赖于预先编程的程序或专门的算法.
- 现有的规划方法与物理世界的连续动态作斗争,需要限制适应性的离散表示.
- 蒙特卡洛树搜索虽然强大,但与连续状态空间不兼容.
研究的目的:
- 介绍光谱扩展树搜索 (SETS),用于连续机器人系统的新型实时规划算法.
- 证明SETS能够在没有特定任务培训的情况下产生复杂的行为和运动轨迹的能力.
- 为了验证SETS在各种机器人平台和充满挑战的动态环境中的适用性.
主要方法:
- 开发了SETS,一种基于树的规划器,利用了局部线性化的系统的频谱.
- 构建了一个低复杂度,离散的近似连续动态的高效的探索.
- 证明了SETS在连续,决定性和可微分的马尔科夫决策过程中的全球最佳解决方案的界限上的融合.
主要成果:
- SETS成功地为无人机,航天器和地面车辆机器人实时计划了复杂的行为.
- 该算法在现有方法无法处理的场景中表现出有效性.
- 实验证实了SETS能够自动发现各种最佳行为和运动轨迹的能力.
结论:
- 在实时机器人规划中,SETS为连续,动态环境提供了显著的进步.
- 该方法为涉及低调动力学,非凸奖励和非结构化设置的问题提供了统一的方法.
- SETS使机器人能够自主适应和发现最佳策略,减少对广泛预编程的需求.
更多相关视频
07:11ARL Spectral Fitting as an Application to Augment Spectral Data via Franck-Condon Lineshape Analysis and Color Analysis
Published on: August 19, 2021
10:44Inherent Dynamics Visualizer, an Interactive Application for Evaluating and Visualizing Outputs from a Gene Regulatory Network Inference Pipeline
Published on: December 7, 2021
相关概念视频
Survival Tree
Building a Survival Tree
Constructing a...
Sampling Plans
Random sampling is a method where each member of the population has an equal chance of being selected for the sample. It involves selecting individuals randomly, often using random number generators or lottery-type methods. For example, when analyzing the properties of a...
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
BIBO stability of continuous and discrete -time systems
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
Multi-input and Multi-variable systems
In the absence...
Linear time-invariant Systems
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
