识别与场景理解和视频时间操纵的应用对象的交互动态
Armand Comas1, Christian Fernandez1, Sandesh Ghimire1
1ECE Dept., Northeastern University, Boston, MA 02115 USA.
概括
我们介绍了基于图形的对象中心动态模式分解 (GrODID) 框架,使用图形神经网络来建模对象动态和相互作用. 这使得机器能够理解复杂的场景,
科学领域:
- 机器学习
- 计算机视觉
- 动态系统
背景情况:
- 机器很难通过象征来理解复杂的场景.
- 从时间序列数据中识别交互对象的动态是至关重要的.
- 目前的方法缺乏对象交互的有效建模.
研究的目的:
- 开发一个新的对象中心动态模式分解框架.
- 让机器能够理解复杂场景的象征性表现.
- 模拟和分析互动对象的动态.
主要方法:
- 引入了GrODID (基于图形的对象中心动态模式分解) 框架.
- 使用图形神经网络 (GNN) 来建模对象交互.
- 使用深度自动编码器通过库普曼运算符识别非线性动态.
主要成果:
- 展示了 GrODID 在模拟交互物体动态方面的能力.
- 成功地将框架应用于视频分析任务.
- 在视频前向/后向预测,操纵和时间超分辨率方面取得了进展.
结论:
- 对于复杂场景的象征性理解, GrODID 提供了一个强大的方法.
- 该框架有效地捕捉了单个对象的动态及其相互作用.
- GrODID显示了增强视频分析和人与人工智能交互的巨大潜力.
相关概念视频
Relative Motion Analysis using Rotating Axes-Problem Solving
449
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
449
Relative Motion Analysis using Rotating Axes
531
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
531
Virtual Work for a System of Connected Rigid Bodies
471
Virtual work is a powerful method used to solve problems involving several connected rigid bodies. When the system is in equilibrium, virtual work is zero. This allows the calculation of the resulting forces when a system undergoes a virtual displacement. When attempting to analyze such a system, first, use a free-body diagram, where an independent coordinate represents the configuration of the links, and mark its deflected position resulting from the positive virtual displacement.
Next,...
Next,...
471
Relative Motion Analysis - Velocity
430
A stroke engine has a slider-crank mechanism that converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider.
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
430
Manipulation and Analysis
59
GIS manipulation and analysis functions are vital for decision-making and planning. These activities range from data retrieval tasks, such as selecting information based on specific criteria, to advanced analytical techniques that address complex spatial problems.One critical GIS analysis method is overlaying, which combines multiple data layers to examine impacts. For example, overlaying a river-dammed lake boundary with road networks can identify affected infrastructure. Another common...
59
Kinematic Equations - II
10.6K
The second kinematic equation expresses the final position of an object in terms of its initial position, the distance traveled with the initial constant velocity, and the distance traveled due to a change in velocity. Similar to the first kinematic equation, this equation is also only valid when the acceleration is constant throughout the motion of an object.
Suppose a car merges into freeway traffic on a 200 m long ramp. If its initial velocity is 10 m/s and it accelerates at 2 m/s2, then the...
Suppose a car merges into freeway traffic on a 200 m long ramp. If its initial velocity is 10 m/s and it accelerates at 2 m/s2, then the...
10.6K


