相关实验视频
Updated: Jul 25, 2026

10:56
Long-term Behavioral Tracking of Freely Swimming Weakly Electric Fish
Published on: March 6, 2014
12.6K
基于学习的不连续路径,遵循生物仿真水下车辆的控制
Yu Wang1,2, Hongfei Chu1, Ruichen Ma1
1State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
Research (Washington, D.C.)
|January 31, 2024
概括
本研究引入了对仿生水下车辆 (BUV) 进行深度强化学习 (DRL) 控制,以导航复杂的,不连续的路径. 该方法可以实现自适应路径切换和翅膀控制,以实现更安全的水下勘探.
科学领域:
- 机器人和控制系统 机器人和控制系统
- 海洋工程 海洋工程
- 人工智能的人工智能
背景情况:
- 仿生水下车辆 (BUVs) 提供灵活的运动,但由于环境障碍,它们需要与不连续的路径作斗争.
- 传统的控制方法缺乏适应力,无法在具有挑战性的水下地形中进行动态路径切换.
- 有效的航行需要强大的控制策略,能够处理不可预测的环境变化.
研究的目的:
- 为BUVs开发基于学习的不连续路径,遵循控制方案.
- 为了使BUV能够在遇到岩石或植被等障碍物时自主切换路径.
- 提高BUV在复杂,非结构化的水下环境中的导航能力.
主要方法:
- 用深度强化学习 (DRL) 方法来开发控制策略.
- 视线 (LOS) 导航算法为马尔科夫决策过程 (MDP) 提供了状态输入.
- 软演员-关键 (SAC) 算法被用来训练BUV的波浪式控制和路径切换.
主要成果:
- 基于DRL的控制器成功训练了BUV学习适应波形和波动频率.
- 在必要时,BUV展示了有效切换路径的能力,例如避免水下障碍物.
- 模拟和实验验证了波动与SAC控制器的集成,用于不连续的路径跟踪.
结论:
- 拟议的基于DRL的控制方案显著改善了BUV在不连续路径后的性能.
- 该方法为BUV导航在具有不规则地形的复杂环境中提供了有效的解决方案.
- 这种方法为自主水下勘探和运营提供了多功能和高效的策略.
相关概念视频
Rolling Resistance: Problem Solving
Rolling resistance, also known as rolling friction, is the force that resists the motion of a rolling object, such as a wheel, tire, or ball, when it moves over a surface. It is caused by the deformation of the object and the surface in contact with each other, as well as other factors like internal friction, hysteresis, and energy losses within the materials. Rolling resistance opposes the object's motion, requiring additional energy to overcome it and maintain movement. In practical...
Hierarchy of Motor Control
The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
Root-Locus Method
A cruise control system in a car is designed to maintain a specified speed automatically by adjusting the gas pedal. The system continuously measures the vehicle's speed and makes fine adjustments to the pedal to achieve this goal. The root locus method is particularly useful for understanding how the cruise control system's behavior changes under varying conditions, such as when the car goes uphill, downhill, or faces strong wind resistance.
This system can be represented by a block diagram,...
This system can be represented by a block diagram,...
Controller Configurations
Controller configurations are crucial in a car's cruise control system because they manage speed over time to maintain a consistent pace regardless of road conditions, thereby meeting design goals. In traditional control systems, fixed-configuration design involves predetermined controller placement. System performance modifications are known as compensation.
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller aligns...
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller aligns...
PD Controller: Design
In automotive engineering, car suspension systems often employ Proportional Derivative (PD) controllers to enhance performance. PD controllers are utilized to adjust the damping force in response to road conditions. A controller, acting as an amplifier with a constant gain, demonstrates proportional control, with output directly mirroring input.
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
Buoyancy and Stability for Submerged and Floating Bodies
In fluid mechanics, buoyancy and stability are key concepts for understanding the behavior of submerged and floating bodies. When a stationary body is fully or partially submerged in a fluid, the fluid exerts a force on the body known as the buoyant force. This force acts vertically upward through a point called the center of buoyancy, which is the center of the displaced fluid volume. According to Archimedes' principle, the magnitude of the buoyant force is equal to the weight of the fluid...

