深いネットワークでジャコビアンフィールドを推論することによって,多様なロボットを制御する
Sizhe Lester Li1, Annan Zhang2, Boyuan Chen2
1Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, USA. sizheli@mit.edu.
Nature
|June 25, 2025
まとめ
この研究は,単一のカメラを使用したロボットの制御のための新しい深層ニューラルネットワーク方法を導入します. このアプローチは,ビデオストリームをロボットにマップします.
科学分野:
- ロボット
- 人工知能
- コンピュータ・ビジョン
背景:
- 生物学的インスピレーションを受けたロボットの制御は 複雑な構造や 多様な材料や 感知能力の欠如により 困難です
- 既存の制御ソフトウェアは 柔軟で多素材のロボットと 闘っていますが 時間の経過とともに 性質が変化します
研究 の 目的:
- 視覚的な入力のみを使用して多様なロボットシステムを制御するための普遍的な方法を開発する.
- 従来のロボットモデリングと非従来のハードウェアの制御の限界を克服する.
主な方法:
- 深いニューラルネットワークを使って ロボットのビデオストリームを 視覚運動のジャコビアン領域にマッピングした
- ランダムなアクチュエータのコマンドを観察することによって,専門家による介入なしにシステムを訓練した.
主要な成果:
- 材料やアクチュエーションに関係なく,単一のカメラを使用してロボットの正確なクローズドループ制御を可能にします.
- 異なる特性を持つ様々なロボットの操作でこの方法を実証した.
- ロボットの因果的動的構造を 復元しました
結論:
- 開発された方法は,ロボットシステムの設計空間を広げています.
- このアプローチは,カメラの入力にのみ依存することで,ロボットによる自動化への障壁を下げます.
関連する概念動画
Multi-input and Multi-variable systems
152
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
152
Sequence Networks of Rotating Machines
150
A Y-connected synchronous generator, grounded through a neutral impedance, is designed to produce balanced internal phase voltages with only positive-sequence components. The generator's sequence networks include a source voltage that is exclusively in the positive-sequence network. The sequence components of line-to-ground voltages at the generator terminals illustrate this configuration.
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
150
Hierarchy of Motor Control
3.7K
The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
3.7K
One-Degree-of-Freedom System
563
In mechanical engineering, one-degree-of-freedom systems form the basis of a wide range of electrical and mechanical components. Using these models, engineers can predict the behavior of various parts in a larger system, which gives them insight into how different forces interact with each other.
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
563
Open and closed-loop control systems
1.0K
Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
1.0K
Transformers in Distribution System
167
Transformers in distribution systems can be broadly categorized into distribution substation transformers and other distribution transformers. They are crucial for stepping down high transmission voltages to levels suitable for distribution and end-user applications.
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
167


