关键点-MoSeq:通过链接点跟踪来分析行为,以提出动态
Caleb Weinreb1, Jonah E Pearl1, Sherry Lin1
1Department of Neurobiology, Harvard Medical School, Boston, MA, USA.
Nature methods
|July 12, 2024
概括
关键点-MoSeq是一个新的AI平台,它从视频中分析动物运动,以识别不同的行为. 它准确地将运动噪声与实际行动分开,揭示了行为的自然结构.
科学领域:
- 伦理学 伦理学 伦理学
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
背景情况:
- 关键点跟踪从视频中量化动物的运动.
- 将连续关键点数据解析成离散的动作是具有挑战性的,因为高频动.
- 现有的集群算法可能会将噪音误解为动作过渡.
研究的目的:
- 开发一个基于机器学习的平台,keypoint-MoSeq,用于从关键点数据中无监督识别行为模块 ("音节").
- 使用生成模型区分运动噪音和实际行为.
- 为了能够准确地将连续姿势动态解析成离散的行为单位.
主要方法:
- 开发了基点-MoSeq,这是一个基于生成模型的平台.
- 训练模型区分关键点噪音和行为信号.
- 应用平台来分析来自各种环境和物种的动物移动数据.
主要成果:
- 关键点-MoSeq成功地识别了与自然姿势动态不连续性相对应的边界的行为音节.
- 该平台在识别动作转换,将神经活动与行为相关联,并对行为进行分类方面优于标准集群方法.
- 关键点-MoSeq证明了多种物种 (老鼠,果) 和行为时间尺度的多功能性.
结论:
- Keypoint-MoSeq提供了一种强大的,无监督的方法,可以从标准视频录制中将复杂的行为剖析成模块化单元.
- 该平台准确地将行为元素与噪音区分开来,在行为学分析方面取得了重大进展.
- 关键点-MoSeq使动物行为的模块化结构可用于研究,使用随时可用的视频数据.
相关概念视频
Relative Motion Analysis - Velocity
354
A stroke engine has a slider-crank mechanism that converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider.
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
354
Relative Motion Analysis using Rotating Axes-Problem Solving
395
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
395
Relative Motion Analysis using Rotating Axes
456
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
456
Relative Motion Analysis - Acceleration
347
A slider-crank mechanism converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider. The movement of the slider-crank is an example of general plane motion as the fluctuating angle between the crank and the connecting rod. Consider a segment AB where point A is at the end of the slider and point B is on the diametrically opposite end to point A, on a crack. The variance in...
347


