シーンの理解とビデオ時間の操作に関するアプリケーションで,相互作用するオブジェクトのダイナミクスを識別する
Armand Comas1, Christian Fernandez1, Sandesh Ghimire1
1ECE Dept., Northeastern University, Boston, MA 02115 USA.
IFAC-PapersOnLine
|August 22, 2025
まとめ
グラフベースのオブジェクト中心のダイナミックモード分解 (GrODID) フレームワークを導入し,オブジェクトダイナミクスとインタラクションをモデル化するためにグラフニューラルネットワークを使用します. これはビデオ予測や操作などのアプリケーションで 複雑なシーンを理解する機械を可能にします
科学分野:
- 機械学習
- コンピュータ・ビジョン
- ダイナミック・システム
背景:
- 機械は複雑な場面を 象徴的に理解するのに苦労します
- タイムシリーズのデータから 相互作用するオブジェクトのダイナミクスを特定することが重要です
- 現在の方法は,オブジェクトの相互作用の効果的なモデリングが欠けている.
研究 の 目的:
- オブジェクト中心のダイナミックモード分解のための新しいフレームワークを開発する.
- 複雑なシーンの象徴的な表現を 機械が理解できるようにする
- 相互作用するオブジェクトのダイナミクスをモデル化し分析する.
主な方法:
- GrODID (グラフベースのオブジェクト中心のダイナミックモード分解) フレームワークが導入されました.
- オブジェクトの相互作用をモデル化するためにグラフニューラルネットワーク (GNN) を利用しました.
- 非線形ダイナミクスのコップマン演算子によるダイナミックモード分解を識別するために深層のオートエンコーダーを使用した.
主要な成果:
- 相互作用するオブジェクトのダイナミクスをモデリングする GrODIDの能力を実証しました.
- フレームワークをビデオ分析のタスクに適用しました.
- ビデオの前方/後方予測,操作,および時間超高解像度での進歩を達成しました.
結論:
- GrODIDは複雑なシーンを象徴的に理解するための強力なアプローチを提供します.
- フレームワークは個々のオブジェクトのダイナミクスとそれらの相互作用の両方を効果的に捉えます.
- GrODIDは,ビデオ分析と人間-AIのインタラクションの強化に重要な可能性を秘めています.
関連する概念動画
01:29Relative Motion Analysis using Rotating Axes-Problem Solving
449
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
449
01:25Relative Motion Analysis using Rotating Axes
531
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
531
01:06Virtual Work for a System of Connected Rigid Bodies
471
Virtual work is a powerful method used to solve problems involving several connected rigid bodies. When the system is in equilibrium, virtual work is zero. This allows the calculation of the resulting forces when a system undergoes a virtual displacement. When attempting to analyze such a system, first, use a free-body diagram, where an independent coordinate represents the configuration of the links, and mark its deflected position resulting from the positive virtual displacement.
Next,...
Next,...
471
01:24Relative Motion Analysis - Velocity
430
A stroke engine has a slider-crank mechanism that converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider.
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
430
01:21Manipulation and Analysis
59
GIS manipulation and analysis functions are vital for decision-making and planning. These activities range from data retrieval tasks, such as selecting information based on specific criteria, to advanced analytical techniques that address complex spatial problems.One critical GIS analysis method is overlaying, which combines multiple data layers to examine impacts. For example, overlaying a river-dammed lake boundary with road networks can identify affected infrastructure. Another common...
59
01:17Kinematic Equations - II
10.6K
The second kinematic equation expresses the final position of an object in terms of its initial position, the distance traveled with the initial constant velocity, and the distance traveled due to a change in velocity. Similar to the first kinematic equation, this equation is also only valid when the acceleration is constant throughout the motion of an object.
Suppose a car merges into freeway traffic on a 200 m long ramp. If its initial velocity is 10 m/s and it accelerates at 2 m/s2, then the...
Suppose a car merges into freeway traffic on a 200 m long ramp. If its initial velocity is 10 m/s and it accelerates at 2 m/s2, then the...
10.6K