使用变压器在3D中定位和识别人类行为
Jiankai Sun1, Linjiang Huang2, Hongsong Wang3
1School of Engineering, Stanford University, Stanford, CA, USA. jksun@cs.stanford.edu.
Communications engineering
|September 3, 2024
概括
研究人员开发了一个新的数据集,BABEL-TAL (BT),用于3D动作本地化,以更好地理解从运动中获得的人类行为. 一个新的模型,LocATe,使用显著少标记的数据实现了最先进的结果.
科学领域:
- 计算机视觉 计算机视觉
- 人类行为分析 人类行为分析
背景情况:
- 从3D运动序列了解人类行为对于各种应用至关重要.
- 三维动作定位,即识别动作及其在动作数据中的定时,是关键的挑战.
研究的目的:
- 引入BABEL-TAL (BT),一个新的,复杂的基准数据集用于3D动作本地化.
- 为BT数据集建立基线,指标和人类评估.
- 提出和验证一个强大的基准模型,用于联合行动本地化和认可.
主要方法:
- 巴贝尔-塔尔 (BT) 数据集的发展.
- 建立基线模型,评估指标和人类评估协议.
- 用变压器定位行动 (LocATe) 模型的提案,用于共同的3D行动定位和识别.
主要成果:
- 在BT数据集上,LocATe模型表现出卓越的性能.
- 在PKU-MMD数据集上,LocATe只使用10%的标记训练数据,实现了最先进的结果.
- 提出的方法提升了3D动作定位的准确性和效率.
结论:
- 该BT数据集为推进3D动作本地化研究提供了一个具有挑战性的基准.
- 在3D运动中分析人类行为,LocATe模型提供了一种高效的方法.
- 这项工作有助于为HCI和医疗保健提供更准确和更有效的人类行为分析系统.
相关概念视频
Transformers
2.1K
A device that transforms voltages from one value to another using induction is called a transformer. A transformer consists of two separate coils, or windings, wrapped around the same soft iron core. However, they are electrically insulated from each other.
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
2.1K
Relative Motion Analysis using Rotating Axes
1.1K
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
1.1K
Transformers with Off-Nominal Turns Ratios
754
In scenarios involving parallel transformers with disparate ratings, developing per-unit models requires accommodating off-nominal turns ratios. This situation arises when the selected base voltages are not proportional to the transformer’s voltage ratings. Consider a transformer where the rated voltages are related by the term a. If the chosen voltage bases satisfy a relationship involving term b, term c is defined as the ratio of these bases. This ratio is then substituted into the...
754


