基于近距离政策优化 (PPO) 的实证和强化学习 (RL) 控制对步行辅助的比较:人工智能总是赢吗?
Nadine Drewing1, Arjang Ahmadi1, Xiaofeng Xiong2
1Department of Human Science, Institute of Sport, Technical University of Darmstadt, 64289 Darmstadt, Germany.
Biomimetics (Basel, Switzerland)
|November 26, 2024
概括
这项研究将经验控制器与可穿戴大腿外套的强化学习 (RL) 控制器进行了比较. 虽然两者都改善了步行,但RL控制器意外地增加了某些肌肉激活,凸显了人工智能驱动辅助设备需要经验数据的需求.
科学领域:
- 生物力学 生物力学
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
背景情况:
- 可穿戴辅助设备在工业和医疗环境中越来越多地使用.
- 将人类专业知识与人工智能 (AI) 结合起来,以提供个性化的帮助,这是一个不断增长的趋势.
- 人工智能在定制支持方面超越人类能力的潜力受到辩论.
研究的目的:
- 调查人工智能驱动的可穿戴下肢辅助设备的控制策略的有效性.
- 将经验控制策略与强化学习 (RL) 优化策略进行比较,用于大腿外套.
- 评估这些控制器对肌肉激活和步行表现的影响.
主要方法:
- 这项研究使用了双关节大腿外套,它模仿腿筋和大腿直肠肌肉的动作.
- 测试了两种控制策略:在神经肌肉模型上使用经验控制器和RL优化的控制器.
- 通过比较肌肉激活 (腿筋,腹肌,大腿,大腿直肠) 和在辅助和无辅助模式中偏好的步行速度来评估表现.
主要成果:
- 实证和RL控制器都减少了腿筋肌肉的激活,并增加了偏好的行走速度.
- 经验控制者也降低了胃肌肌肉活动.
- 基于RL的控制器导致了巨和直骨肌肉激活的增加.
结论:
- 可穿戴辅助设备可以通过实证和基于人工智能的方法来控制,以帮助人类行走.
- 强化学习在辅助设备控制中的学习优化在没有经验验证的情况下,可能并不总能产生优异的结果.
- 未来人工智能驱动的辅助技术需要仔细整合人类的专业知识和经验数据,以确保最佳和安全的性能.
相关概念视频
PD Controller: Design
191
In automotive engineering, car suspension systems often employ Proportional Derivative (PD) controllers to enhance performance. PD controllers are utilized to adjust the damping force in response to road conditions. A controller, acting as an amplifier with a constant gain, demonstrates proportional control, with output directly mirroring input.
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
191
Controller Configurations
85
Controller configurations are crucial in a car's cruise control system because they manage speed over time to maintain a consistent pace regardless of road conditions, thereby meeting design goals. In traditional control systems, fixed-configuration design involves predetermined controller placement. System performance modifications are known as compensation.
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
85
PI Controller: Design
207
Proportional Integral (PI) controllers are a fundamental component in modern control systems, widely used to enhance performance and mitigate steady-state errors. They are particularly effective in applications such as automatic brightness adjustment on smartphones, where they excel at mitigating steady-state errors for step-function inputs. Unlike PD controllers, which require time-varying errors to function optimally, PI controllers leverage their integral component to address residual...
207
Time-Domain Interpretation of PD Control
83
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
Consider the example of control of motor torque. Initially, a positive...
83
Root-Locus Method
128
A cruise control system in a car is designed to maintain a specified speed automatically by adjusting the gas pedal. The system continuously measures the vehicle's speed and makes fine adjustments to the pedal to achieve this goal. The root locus method is particularly useful for understanding how the cruise control system's behavior changes under varying conditions, such as when the car goes uphill, downhill, or faces strong wind resistance.
This system can be represented by a block...
This system can be represented by a block...
128
Hierarchy of Motor Control
2.5K
The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
2.5K


