强大的视觉运动控制用于使用混合增强学习的人形位置操纵
Chenzheng Wang1, Qiang Huang1, Xuechao Chen1
1School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China.
Biomimetics (Basel, Switzerland)
|July 25, 2025
概括
这项研究为人形机器人提供了一个新的框架,可以执行复杂的任务,例如携带和打开门. 强化学习 (RL) 方法增强视觉运动控制,通过适应环境变化,达到83%的成功率.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
- 控制系统 控制系统
背景情况:
- 人形机器人对实际任务有价值.
- 强化学习 (RL) 提供了强大的控制,但在高维,长视界的局部操纵任务中面临挑战.
- 在这些任务中,视觉运动控制特别困难.
研究的目的:
- 为人形机器人提出一种新的 loco-manipulation 控制框架.
- 解决基于RL的视觉运动控制中高维度和长视野探索的挑战.
- 提高人形机器人在复杂任务中的适应性和成功率.
主要方法:
- 利用无模型的强化学习 (RL),与机器人的任务空间中的基于模型的控制集成.
- 实施了使用深度图像输入的视觉运动政策.
- 采用中期初始化和优先采集经验,以加快政策趋同.
主要成果:
- 在典型的机车操纵任务中取得了83%的总体成功率,包括载荷和打开门.
- 证明了框架能够根据环境变化自动调整机器人运动的能力.
- 验证了拟议的基于RL的视觉运动控制方法的有效性.
结论:
- 拟议的框架大大提高了人形机器人在局部操纵任务中的能力.
- 无模型的RL与基于模型的控制的整合,加上特定的优化技术,克服了关键的挑战.
- 系统对环境动态的适应性对于现实世界的应用至关重要.
更多相关视频
11:53The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy
Published on: October 14, 2017
11.8K
04:49Author Spotlight: Enhancing Post-Stroke Upper Limb Rehabilitation with Robotic Technologies for Improved Motor Recovery and Functional Outcomes
Published on: September 6, 2024
884
相关概念视频
Hierarchy of Motor Control
3.6K
The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
3.6K
Open and closed-loop control systems
1000
Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
1000
Observational Learning
314
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
314
Root-Locus Method
213
A cruise control system in a car is designed to maintain a specified speed automatically by adjusting the gas pedal. The system continuously measures the vehicle's speed and makes fine adjustments to the pedal to achieve this goal. The root locus method is particularly useful for understanding how the cruise control system's behavior changes under varying conditions, such as when the car goes uphill, downhill, or faces strong wind resistance.
This system can be represented by a block...
This system can be represented by a block...
213
One-Degree-of-Freedom System
557
In mechanical engineering, one-degree-of-freedom systems form the basis of a wide range of electrical and mechanical components. Using these models, engineers can predict the behavior of various parts in a larger system, which gives them insight into how different forces interact with each other.
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
557
Reinforcement
343
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
343
