阿凡达:人工智能视觉分析,用于实时的三维行动
Dae-Gun Kim1, Kwanhoo Shin1, Anna Shin1
1Department of Biological Sciences, KAIST, Daejeon 34141, Korea.
Experimental neurobiology
|March 2, 2026
概括
阿凡达是一个人工智能系统,可以从视频中重建3D鼠标运动,以进行详细的行为分析. 这项技术使实验中的动物行为的自动,实时分类和操纵成为可能.
科学领域:
- 神经科学是一个神经科学.
- 计算机科学 计算机科学
- 伦理学 伦理学 伦理学
背景情况:
- 人工智能 (AI) 为高分辨率的行为分析和自动化实验提供了先进的功能.
- 目前用于分析动物行为的方法可能是劳动密集型,缺乏实时处理.
- 需要精确的,自动化的系统来量化模型生物的复杂行为.
研究的目的:
- 介绍AVATAR (AI视觉分析实时三维动作),这是一个人工智能驱动的系统,用于重建和分析3D鼠标运动.
- 为了实现自动化,低延迟的行为分类和闭环实验控制.
- 为了证明系统在不同行为范式的概括性.
主要方法:
- 阿凡达利用同步的多视图视频来检测关键的身体部位,并将3D鼠标姿势重建为动作骨.
- 该系统使用长短期记忆 (LSTM) 网络,根据提取的动态和姿势特征进行行为分类.
- 阿凡达集成了低延迟处理 (100毫秒) 实时应用,包括闭环光遗传刺激.
主要成果:
- 阿凡达在3D姿势估计和行为特征的强大提取方面实现了接近人类的准确性.
- 该系统可靠地在各种实验范式中对自由移动的老鼠行为进行分类.
- 阿凡达成功应用于掠夺性狩猎范式,在复杂的追逐行为中实现自动化行动细分.
结论:
- 阿凡达为3D姿势估计,动态量化和小鼠实时行为分类提供了全面的解决方案.
- 该系统促进自动化,无人实验和实时闭环操纵.
- 阿凡达增强了模型动物研究中的行为分析的可扩展性和精度.
相关概念视频
Three-Dimensional Force System:Problem Solving
1.4K
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
1.4K
Depth Perception and Spatial Vision
2.4K
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
2.4K
Absolute Motion Analysis- General Plane Motion
632
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
632
Relative Motion Analysis using Rotating Axes-Problem Solving
804
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
804
Three-Dimensional Force System
3.0K
In mechanical engineering, a three-dimensional force system is a system of forces acting in three dimensions, with forces applied along the x, y, and z coordinate axes. The three-dimensional force system is an important concept in mechanical engineering, as it allows engineers to understand and analyze the behavior of objects and structures in three dimensions. By understanding the forces acting on a system, engineers can design more efficient and effective mechanical systems that can withstand...
3.0K
Support Reactions in Three Dimensions
1.7K
Support reactions in three dimensions help maintain the stability and equilibrium of various structures and systems. These reactions prevent the system from translating and rotating, ensuring the design can withstand external forces and perform its intended function efficiently and safely. Some of the supports providing support reactions in three dimensions are discussed below:
Ball and Socket Joint is one of the supports allowing free rotation about any axis. This freedom of rotation is...
Ball and Socket Joint is one of the supports allowing free rotation about any axis. This freedom of rotation is...
1.7K


