基于模型的强化学习用于超声驱动的自主微机器人.
Mahmoud Medany1, Lorenzo Piglia1, Liam Achenbach1
1Acoustic Robotics Systems Lab, Institute of Robotics and Intelligent Systems, Department of Mechanical and Process Engineering, ETH Zurich, Rüschlikon, Switzerland.
Nature machine intelligence
|July 25, 2025
概括
本研究介绍了基于模型的强化学习,用于超声微机器人的自主控制. 人工智能系统使用有限的数据高效地导航复杂的环境,在导航和操纵任务中取得高成功率.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
- 生物医学工程 生物医学工程
背景情况:
- 强化学习 (RL) 为微机器人提供了自主控制,但面临着诸如大数据需求和糟糕的概括性等挑战.
- 超声波驱动的微机器人需要在复杂,高维的行动空间中快速,精确的控制,超过人类操作员的能力.
研究的目的:
- 开发一个以样本效率,基于模型的强化学习算法,用于超声驱动微机器人的自主控制.
- 使微机器人能够从有限的数据中学习,并有效地适应新的环境.
主要方法:
- 实施基于模型的强化学习 (MBRL),利用反复的想象环境进行培训.
- 在对物理任务进行微调之前,在模拟环境中训练人工智能模型.
- 在数据稀缺的场景中利用基于图像的学习.
主要成果:
- 在一个小时的微调后,在避免碰撞和通道导航方面取得了90%的成功率.
- 证明成功地将其通用化到新的环境中,通过30分钟的额外培训,从50%提高到90%以上.
- 在静态和流量条件下,展示了微机器人在复杂的血管中实时操纵.
结论:
- 基于模型的强化学习为数据稀缺环境中的自主微机器人控制提供了有效的解决方案.
- 由人工智能驱动的微机器人通过精确的导航和操纵,显示出了彻底改变生物医学应用的巨大潜力.
相关概念视频
Motor Units
A motor unit consists of two main components: a single efferent motor neuron (i.e., a neuron that carries impulses away from the central nervous system) and all of the muscle fibers it innervates. The motor neuron may innervate multiple muscle fibers, which are single cells, but only one motor neuron innervates a single muscle fiber.
Mechanical Efficiency of Real Machines
The mechanical efficiency of a machine is a fundamental concept that describes how effectively a machine can convert input work into output work. According to this concept, the efficiency of a machine is equal to the ratio of the output work to the input work. An ideal machine, meaning a machine that has no energy losses, has an efficiency of one. This implies that the input work and the output work are equal.
However, in reality, no machine can be truly ideal, and all of them experience some...
However, in reality, no machine can be truly ideal, and all of them experience some...
Motor Units
The motor unit is a fundamental component of the neuromuscular system and plays a crucial role in coordinating muscle contractions. It consists of a somatic motor neuron, which connects and controls multiple skeletal muscle fibers, forming a single functional segment. The axon of the motor neuron branches out and establishes synaptic connections known as neuromuscular junctions with individual muscle fibers within the motor unit.
Motor units come in different sizes, with smaller units...
Motor units come in different sizes, with smaller units...
Motor Unit Stimulation
When the neuron of a motor unit fires an action potential, it triggers a series of events, leading to a twitch contraction in the muscle fibers. The process of excitation-contraction coupling is crucial in relaying the action potential to the muscle fibers.
The latent period of contraction marks the onset of excitation-contraction coupling, when the action potential propagates across the sarcolemma, preparing the muscle fibers for contraction. As the fibers enter the contraction phase, the...
The latent period of contraction marks the onset of excitation-contraction coupling, when the action potential propagates across the sarcolemma, preparing the muscle fibers for contraction. As the fibers enter the contraction phase, the...
Mechanical Systems
Mechanical systems are analogous to to electrical networks where springs and masses play similar roles to inductors and capacitors, respectively. A viscous damper in mechanical systems functions similarly to a resistor in electrical networks, dissipating energy. The forces acting on a mass in such systems include an applied force in the direction of motion, counteracted by forces from the spring, a viscous damper, and the mass's acceleration. This interplay of forces is mathematically described...
Electro-mechanical Systems
Electromechanical systems are intricate configurations that effectively combine electrical and mechanical elements to achieve a desired outcome. Central to many of these systems is the DC motor, a device that converts electrical energy into mechanical motion, enabling various applications ranging from simple fans to complex robotic mechanisms.
A key component of the DC motor is the armature, a rotating circuit positioned within a magnetic field. As an electric current passes through the...
A key component of the DC motor is the armature, a rotating circuit positioned within a magnetic field. As an electric current passes through the...


