摩聊:关节分组的时空接地多模式大语言模型,用于多转动作理解和描述
IEEE journal of biomedical and health informatics
|November 10, 2025
概括
摩聊是一个多式联络大型语言模型,精确地基于人类在空间和时间上的运动. 这种进步对于家庭炼监测和康复等应用至关重要,使得准确的分析和个性化指导成为可能.
科学领域:
- 计算机视觉 计算机视觉
- 人与计算机的交互
- 人工智能的人工智能
背景情况:
- 对于人类运动分析的深度学习模型通常在识别动作时间和身体部位方面缺乏准确性.
- 目前的模型通常只支持单回合交互,从而限制了它们在复杂场景中的实用性.
- 精确的运动分析对于家庭炼,神经评估和康复至关重要.
研究的目的:
- 为了介绍MoChat,一个新的多式联络大型语言模型.
- 为了使人类运动的时空接地和多轮对话理解.
- 为了解决当前人类运动分析模型的局限性.
主要方法:
- 在骨架框架中按解剖结构分组空间特征,使用关节分组骨架编码器.
- 融合编码器输出与大型语言模型嵌入式,用于空间意识的表示.
- 采用基于交叉注意力的回归头来实现精确的时间接地,并开发时间/空间接地任务的管道.
主要成果:
- 在运动理解任务中,MoChat 实现了最先进的性能.
- 证明了人类运动精细的时空接地能力.
- 成功地将多轮对话理解与运动分析相结合.
结论:
- MoChat代表了人类运动分析的重大进步.
- 该模型的时空接地功能增强了医疗保健和运动中的应用.
- MoChat是第一个实现人类运动微粒度时空接地的模型.
相关概念视频
Functional Classification of Joints
6.5K
Functional Classification of Joints
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
6.5K
Structural Classification of Joints
6.9K
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...
6.9K
Absolute Motion Analysis- General Plane Motion
513
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
513
Relative Motion Analysis using Rotating Axes
868
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
868
Relative Motion Analysis using Rotating Axes-Problem Solving
689
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
689
Higher Mental Functions of the Brain: Language
3.4K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
3.4K

