通过深度网络推断雅科比字段来控制各种机器人
Sizhe Lester Li1, Annan Zhang2, Boyuan Chen2
1Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, USA. sizheli@mit.edu.
Nature
|June 25, 2025
概括
这项研究引入了一种新的深度神经网络方法,用于只使用一台摄像头来控制机器人. 这种方法将视频流映射到机器人
科学领域:
- 机器人技术
- 人工智能
- 计算机视觉
背景情况:
- 由于机器人结构复杂,材料多样化以及缺乏传感能力,
- 现有的控制软件与柔软的多材料机器人作斗争,
研究的目的:
- 开发一种只使用视觉输入控制各种机器人系统的通用方法.
- 克服传统机器人模拟和控制的局限性.
主要方法:
- 使用深度神经网络将机器人视频流映射到它们的视觉运动中.
- 在没有专家干预的情况下通过观察随机执行命令来训练系统.
主要成果:
- 使用单个摄像头实现精确的闭环机器人控制,无论材料或执行.
- 在不同特征的机器人操纵器上演示该方法.
- 成功地恢复了每个机器人的因果动态结构.
结论:
- 开发的方法扩大了机器人系统的设计空间.
- 这种方法降低了机器人自动化的障碍,
相关概念视频
Multi-input and Multi-variable systems
152
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
152
Sequence Networks of Rotating Machines
150
A Y-connected synchronous generator, grounded through a neutral impedance, is designed to produce balanced internal phase voltages with only positive-sequence components. The generator's sequence networks include a source voltage that is exclusively in the positive-sequence network. The sequence components of line-to-ground voltages at the generator terminals illustrate this configuration.
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
150
Hierarchy of Motor Control
3.7K
The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
3.7K
One-Degree-of-Freedom System
563
In mechanical engineering, one-degree-of-freedom systems form the basis of a wide range of electrical and mechanical components. Using these models, engineers can predict the behavior of various parts in a larger system, which gives them insight into how different forces interact with each other.
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
563
Open and closed-loop control systems
1.0K
Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
1.0K
Transformers in Distribution System
167
Transformers in distribution systems can be broadly categorized into distribution substation transformers and other distribution transformers. They are crucial for stepping down high transmission voltages to levels suitable for distribution and end-user applications.
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
167


