文本转换为盲人运动
Hee Jae Kim1, Kathakoli Sengupta1, Masaki Kuribayashi2
1Boston University.
Advances in neural information processing systems
|April 23, 2025
概括
本研究介绍了BlindWays,这是一个新的数据集和3D人类运动分析的基准,重点是盲人行人. 目前的运动模型很难预测盲人独特的运动,这凸显了对更多样化的数据集的需求.
科学领域:
- 计算机视觉 计算机视觉
- 机器人技术 机器人技术 机器人技术
- 人与计算机的交互
背景情况:
- 视觉人士的运动数据主导了当前的3D人类运动模型.
- 盲人行人表现出明显的运动模式,这些模式并未被现有的模型所捕捉到.
- 为了安全,自动驾驶系统需要理解人类的各种运动.
研究的目的:
- 为盲人行人推出第一个多式联动运动基准.
- 在这些新数据上评估最先进的3D人类运动预测模型的性能.
- 促进包容性人工智能系统的发展,这些系统可以对各种人类运动进行推理.
主要方法:
- 在城市环境中使用可穿戴传感器收集了来自11名盲人参与者的3D运动数据.
- 开发了一个多式联运基准,包括丰富的行人行为和环境相互作用的文本描述.
- 在新数据集上对现有的3D人类运动预测模型进行了基准测试.
主要成果:
- 现有的3D人类运动预测模型在盲人行人数据上表现不佳.
- 现货和预训练模型未能准确地捕捉出明显的运动特征.
- BlindWays基准揭示了当前运动建模的重大局限性.
结论:
- 目前的3D人类运动模型对盲人行人来说不够多样化或强大.
- BlindWays数据集对于开发更安全,更可靠的人工智能系统至关重要.
- 需要进一步的研究,以提高人工智能对人类多样性移动性的理解.
更多相关视频
09:46MPI CyberMotion Simulator: Implementation of a Novel Motion Simulator to Investigate Multisensory Path Integration in Three Dimensions
Published on: May 10, 2012
12.6K
09:01Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
Published on: March 27, 2013
14.3K
相关概念视频
Relative Motion Analysis - Velocity
328
A stroke engine has a slider-crank mechanism that converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider.
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
328
Relative Motion Analysis - Acceleration
313
A slider-crank mechanism converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider. The movement of the slider-crank is an example of general plane motion as the fluctuating angle between the crank and the connecting rod. Consider a segment AB where point A is at the end of the slider and point B is on the diametrically opposite end to point A, on a crack. The variance in...
313
Absolute Motion Analysis- General Plane Motion
193
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
193
Planar Rigid-Body Motion
362
Understanding the movement of a rigid body in planar motion involves recognizing that every particle within this body is traversing a path that maintains a consistent distance from a specific plane. This concept is fundamental in the study of physics and mechanical engineering, and it allows us to comprehend better how objects move in space.
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
362
Relative Motion Analysis using Rotating Axes
433
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
433
Fluid Movement Between Compartments
350
The force applied by fluids against a surface, known as hydrostatic pressure, initiates the transfer of fluid among different compartments. Within our blood vessels, the blood's hydrostatic pressure is a result of the heart's pumping action. At the arteriolar end of capillaries, hydrostatic pressure (capillary blood pressure) exceeds the opposing colloid osmotic pressure created primarily by plasma proteins like albumin. This discrepancy in pressure propels plasma and nutrients from the...
350
