基于视觉的识别人类的动作意图在楼梯接近时
Md Rafi Islam1, Md Rejwanul Haque2, Masudul H Imtiaz3
1Department of Electrical and Computer Engineering, The University of Alabama, Tuscaloosa, AL 35487, USA.
Sensors (Basel, Switzerland)
|June 10, 2023
概括
这项研究引入了一种基于视觉的系统,可以使用头戴式摄像头预测某人是否会爬楼梯. 该方法在运动变化之前准确地识别了辅助机器人的运动意图.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 计算机视觉 计算机视觉
- 人与计算机的交互
背景情况:
- 现实世界的导航需要持续的决策,比如选择爬楼梯或避开楼梯.
- 识别用于辅助机器人控制 (例如假肢) 的动作意图至关重要,但由于信息有限,很难.
研究的目的:
- 开发一种基于视觉的新方法,用于识别一个人接近楼梯时的动作意图.
- 为了使辅助机器人能够在运动模式发生变化之前预测和适应用户的意图.
主要方法:
- 利用头戴摄像机的自我中心图像.
- 训练了一个YOLOv5物体检测模型来识别楼梯.
- 开发了一个AdaBoost和梯度提升 (GB) 分类器来确定意图 (参与或避免楼梯).
主要成果:
- 实现了可靠的动作意图识别,准确率为97.69%.
- 在潜在的过渡到爬楼梯之前至少两步成功预测了意图.
- 证明了该方法在为机器人控制器调整提供及时信息方面的有效性.
结论:
- 提出的基于视觉的方法可靠地使用自我中心视觉预测爬楼梯的意图.
- 这种方法为辅助机器人控制提供了显著的进步,提高了现实世界的可用性.
- 早期的意图识别可以在辅助机器人系统中进行主动调整.
更多相关视频
09:46MPI CyberMotion Simulator: Implementation of a Novel Motion Simulator to Investigate Multisensory Path Integration in Three Dimensions
Published on: May 10, 2012
12.7K
06:37Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
Published on: December 15, 2023
3.9K
相关概念视频
Relative Motion Analysis using Rotating Axes-Problem Solving
425
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
425
Absolute Motion Analysis- General Plane Motion
243
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
243
Relative Motion Analysis using Rotating Axes
490
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
490
Upward Impending Motion
336
A square-threaded screw jack is a mechanical device widely used for lifting heavy loads or applying considerable force. Its operation is based on converting the force applied at its handle into a torsional moment, causing the upward impending motion of the screw. This movement is accomplished by overcoming the static friction between the threads of the screw and the jack.
To better comprehend how a screw jack functions, consider the completely unraveled thread as a block in contact with the...
To better comprehend how a screw jack functions, consider the completely unraveled thread as a block in contact with the...
336
Planar Rigid-Body Motion
482
Understanding the movement of a rigid body in planar motion involves recognizing that every particle within this body is traversing a path that maintains a consistent distance from a specific plane. This concept is fundamental in the study of physics and mechanical engineering, and it allows us to comprehend better how objects move in space.
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
482
