B2C-AFM:双向同时时间和跨空间注意力融合模型用于人类行动识别
概括
这项研究引入了一种新的双向同时时间和跨空间注意力融合模型 (B2C-AFM),用于强大的人类行动识别. 该模型增强了多模式特征融合,并使用肢体流场 (Lff) 来改善姿势表示,在各种行动中实现更好的性能.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 人与计算机的交互
背景情况:
- 当前的人类行动识别方法整合了RGB图像和人类姿势等模式.
- 现有的方法面临着各种挑战,包括摆设错误,时间模糊性,有限的可扩展性和稳定性.
研究的目的:
- 开发一种用于改进人类行动识别的新型模型.
- 通过增强多模式特征融合和姿势表示来解决现有方法的局限性.
主要方法:
- 提出了一种双向的同时和跨空间注意力融合模型 (B2C-AFM).
- 引入了肢体流场 (Lff),用于明确的以运动为导向的姿势表示.
- 在跨时间和空间维度的多模式特征中采用异步融合策略.
主要成果:
- B2C-AFM在人类行动识别任务上表现出强的表现.
- 实验验证实了该模型在已见和未见的人类行为中的有效性.
- 废弃性研究证实了拟议方法的贡献.
结论:
- B2C-AFM有效地整合了多模式功能,以实现卓越的人类行动识别.
- 肢体流场 (Lff) 缓解了人类姿势数据中的时间模糊性.
- 拟议的模型为人机交互应用程序提供了增强的可扩展性和稳定性.
相关概念视频
Association Areas of the Cortex
5.5K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.5K
Parallel Processing
179
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
179


