ETPNav:在连续环境中发展视觉语言导航的拓规划
概括
本研究介绍ETPNav,这是一个用于连续环境中的视觉语言导航 (VLN-CE) 的新框架. ETPNav增强了代理导航规划和障碍回避,显著提高了基准数据集的性能.
科学领域:
- 具体的人工智能
- 机器人技术 机器人技术 机器人技术
- 计算机视觉 计算机视觉
背景情况:
- 视觉语言导航 (VLN) 对体内人工智能至关重要,使代理商能够在环境中遵循指令.
- 现有的VLN方法在连续的现实环境中面临挑战.
研究的目的:
- 提出一个强大的框架,ETPNav,用于连续环境中的视觉语言导航 (VLN-CE).
- 提高代理商在环境抽象,远程规划和避障控制方面的能力.
主要方法:
- ETPNav使用在线拓映射,使用自组织的路点进行环境抽象.
- 一个基于变压器的跨模式规划器从拓地图和说明中生成导航计划.
- 具有试错启发式的避障控制器可确保顺的导航.
主要成果:
- 在连续环境中,ETPNav在视觉语言导航中表现出卓越的性能.
- 该框架在R2R-CE和RxR-CE数据集上分别实现了超过10%和20%的改进.
- 实验结果验证了提议的ETPNav方法的有效性.
结论:
- ETPNav为连续环境的视觉语言导航提供了显著的进步.
- 提出的方法有效地解决了长期规划和避免障碍的挑战.
- ETPNav为更有能力的体内人工智能代理在现实世界应用中铺平了道路.
相关概念视频
Depth Perception and Spatial Vision
643
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
643
Hierarchy of Motor Control
2.7K
The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
2.7K
Fluid Movement Between Compartments
514
The force applied by fluids against a surface, known as hydrostatic pressure, initiates the transfer of fluid among different compartments. Within our blood vessels, the blood's hydrostatic pressure is a result of the heart's pumping action. At the arteriolar end of capillaries, hydrostatic pressure (capillary blood pressure) exceeds the opposing colloid osmotic pressure created primarily by plasma proteins like albumin. This discrepancy in pressure propels plasma and nutrients from the...
514
Design Example: Traverse Angle Computations
78
Traverse angle computations are a critical component of surveying, used to compute the internal angles within a closed traverse. A traverse consists of a series of connected lines forming a closed loop, often used for land boundary delineation or mapping. Calculating the internal angles ensures accuracy in the traverse geometry and is essential for checking survey data integrity.The process begins with known azimuths and bearings of the traverse sides. Internal angles at each vertex are...
78
Plotting of Topographic Maps
44
Topographic maps represent the Earth's surface features using contour lines, which connect points of equal elevation to create a two-dimensional representation of three-dimensional terrain. Creating a topographic map requires a systematic approach.Begin by plotting a scaled grid and marking intersections corresponding to the survey's elevation data points. Assign elevation values at these intersections to build the base map. Next, determine contour levels using a consistent contour interval,...
44
Design Example: Alignment of a Road Line Using GIS
48
The alignment of a road line using Geographic Information Systems (GIS) is a critical process in civil engineering, combining advanced technology with practical decision-making. This methodology begins with the collection of geospatial data, including information on land cover, geomorphology, drainage patterns, slope, and contour details. Such data is typically acquired through satellite imagery and GIS tools, offering a comprehensive understanding of the terrain.Once the data is gathered, it...
48


