大脑启发的多式联动运动和细粒度的动作识别
Yuening Li1, Xiuhua Yang1, Changkui Chen2
1Wuhan Sports University, Wuhan, China.
Frontiers in neurorobotics
|February 10, 2025
概括
这项研究介绍了FGM-CLIP,这是一种用于细粒度动作识别的新型多式联络方法. 它通过整合视觉和运动数据,显著提高复杂视频的准确性.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
背景情况:
- 单模方法限制了细粒度的动作识别,特别是复杂的动作和微妙的运动变化.
- 传统的方法通常使用手工制作的功能或简单的CNN,阻碍有效的多式联络融合.
研究的目的:
- 通过使用一种新的多式联络架构来增强细粒度动作识别.
- 在复杂的视频数据中克服单模式方法的局限性.
主要方法:
- 介绍了FGM-CLIP (细粒度运动CLIP),这是一个利用对比语言图像预训练 (CLIP) 的新型架构.
- 集成了一个细粒度运动编码器和一个多模式融合层,用于端到端的动作识别.
- 联合优化视觉和运动功能,以捕捉微妙的动作变化.
主要成果:
- 在多个细粒度动作识别数据集上,FGM-CLIP显著优于现有方法.
- 多式联接融合战略提高了复杂的动作模式的模型稳定性和准确性.
- 在复杂的视频数据中实现更高的分类准确性.
结论:
- 与传统方法相比,FGM-CLIP提供了一种优越的细粒度动作识别方法.
- 多模式融合对于准确解释视频中的微妙动作和复杂运动至关重要.
- 拟议的架构有效地利用CLIP来增强视频理解.
相关概念视频
Fixed Action Patterns
18.2K
A fixed action pattern (FAP) is a specific, hard-wired sequence of behaviors that occurs in response to an external stimulus, called a sign stimulus. The behavior is “fixed” because it is essentially unchangeable—proceeding similarly across individuals of a species every time it occurs.
18.2K
Muscle Coordination and Action
3.9K
Muscle coordination is a complex and finely tuned process essential for smooth and purposeful movements like flexion, extension, adduction, abduction, and rotation. The human body orchestrates the actions of various muscles working in concert, each with a specific role. Four functional types describe how muscles work together: agonist, antagonist, synergist, and fixator.
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement....
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement....
3.9K
Absolute Motion Analysis- General Plane Motion
715
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
715


