通过双重注意力和多颗粒度时间卷积网络进行人类运动预测
Biaozhang Huang1,2, Xinde Li1,2
1Key Laboratory Measurement and Control of CSE Ministry of Education, School of Automation, Southeast University, Nanjing 210002, China.
Sensors (Basel, Switzerland)
|July 8, 2023
概括
这项研究引入了一种使用双重注意力和多颗粒度时间卷积网络 (DA-MgTCNs) 的新人类运动预测方法. 这种新的方法通过提高运动预测准确度来增强人类和智能设备之间的互动.
科学领域:
- 计算机科学 计算机科学
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
背景情况:
- 智能设备越来越多地融入日常生活,需要精确的人类运动分析才能有效地进行人机交互.
- 目前的人类运动预测方法难以捕捉运动数据中的复杂的空间和时间动态,限制了预测准确度.
研究的目的:
- 开发一种新的人类运动预测方法,有效地捕捉空间相关性和时间依赖性.
- 提高人类运动预测的准确性和可靠性,以增强人机交互.
主要方法:
- 提出了一种双重注意力 (DA) 模型,整合了联合和道注意力,以从3D人类运动数据中提取空间特征.
- 开发了多颗粒度时间卷积网络 (MgTCNs),具有多种受体场,以捕捉运动序列中复杂的时间依赖.
- 使用Human3.6M和CMU-Mocap数据集进行全面评估.
主要成果:
- 拟议的DA-MgTCNs方法在短期和长期人类运动预测方面显著优于现有的方法.
- 在基于顺序数据准确预测未来人类姿势和运动方面表现出卓越的性能.
- 验证了双重注意力机制和多颗粒度时间建模的有效性.
结论:
- 新的DA-MgTCNs方法在人类运动预测准确度方面取得了重大进展.
- 这种方法促进了人类与智能设备之间更加和的共存和高效的互动.
- 这些发现突显了先进的深度学习架构在复杂运动分析方面的潜力.
相关概念视频
01:07End Point Prediction: Gran Plot
388
A Gran plot is used to predict the equivalence volume or endpoint of a potentiometric or acid-base titration without reaching the endpoint. Typically, titration data is collected as a function of the titrant's volume up to a point less than the equivalence volume and then transformed into a linear format. The straight line is extended to the x-axis, indicating the necessary titrant volume to achieve the equivalence point.
For potentiometric titration, the Gran plot is created by plotting...
For potentiometric titration, the Gran plot is created by plotting...
388
01:24Absolute Motion Analysis- General Plane Motion
243
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
243
01:25Relative Motion Analysis using Rotating Axes
489
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
489
01:22Multi-input and Multi-variable systems
132
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
132