基于强化学习的轨迹跟踪在狭窄水域中对无人驾驶水面车辆进行最佳控制
1School of Marine Electrical Engineering, Dalian Maritime University, Dalian 116026, China.
ISA transactions
|February 7, 2025
概括
本研究引入了一个强化学习 (RL) 控制方案,用于无人驾驶水面车辆 (USV) 在封闭水域追踪轨迹. 该方法提高了导航稳定性,尽管存在未知的干扰,但能耗降低了14.6%.
科学领域:
- 机器人和控制系统 机器人和控制系统
- 海洋工程 海洋工程
- 人工智能的人工智能
背景情况:
- 无人驾驶地面车辆 (USV) 在狭窄的水道中面临挑战,原因是未知的动态和环境干扰.
- 在运动约束下确保稳定的轨迹跟踪对于USV操作至关重要.
研究的目的:
- 开发一种基于强化学习 (RL) 的最佳控制方案,用于在狭窄水域追踪USV轨迹.
- 为了有效地解决运动状态限制和未知的环境干扰.
主要方法:
- 非线性映射将受约束的运动错误转化为边界错误.
- 使用具有自适应神经网络 (NN) 的演员-关键框架.
- 一个新的批评者NN重量更新法结合了梯度下降和并发学习,放松刺激条件.
- 集成了一个干扰补偿器,以处理未知的动态和干扰.
主要成果:
- 开发的控制方案保证了闭环系统中所有信号的局限性.
- 模拟表明在狭窄的水域中成功追踪轨迹.
- 与现有方法相比,拟议的控制器可实现大约14.6%的能源消耗降低.
结论:
- 基于RL的最佳控制方案有效地管理在具有挑战性的环境中USV轨迹跟踪.
- 该方法提高了USV的航行安全和运营效率.
- 该方法为在狭窄的水域中实现自主导航提供了强大的解决方案.
更多相关视频
05:57Long-term Video Tracking of Cohoused Aquatic Animals: A Case Study of the Daily Locomotor Activity of the Norway Lobster Nephrops norvegicus
Published on: April 8, 2019
6.8K
08:18WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
Published on: August 15, 2020
4.9K
相关概念视频
Control Systems
2.0K
Control systems are everywhere in contemporary society, influencing diverse applications from aerospace to automated manufacturing. These systems can be found naturally within biological processes, such as blood sugar regulation and heart rate adjustment in response to stress, as well as in man-made systems like elevators and automated vehicles. A control system is essentially a network of subsystems and processes that collaboratively convert specific inputs into desired outputs.
At the heart...
At the heart...
2.0K
Open and closed-loop control systems
2.0K
Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
2.0K
Root-Locus Method
583
A cruise control system in a car is designed to maintain a specified speed automatically by adjusting the gas pedal. The system continuously measures the vehicle's speed and makes fine adjustments to the pedal to achieve this goal. The root locus method is particularly useful for understanding how the cruise control system's behavior changes under varying conditions, such as when the car goes uphill, downhill, or faces strong wind resistance.
This system can be represented by a block...
This system can be represented by a block...
583
Buoyancy and Stability for Submerged and Floating Bodies
4.5K
In fluid mechanics, buoyancy and stability are key concepts for understanding the behavior of submerged and floating bodies. When a stationary body is fully or partially submerged in a fluid, the fluid exerts a force on the body known as the buoyant force. This force acts vertically upward through a point called the center of buoyancy, which is the center of the displaced fluid volume. According to Archimedes' principle, the magnitude of the buoyant force is equal to the weight of the fluid...
4.5K
Uniform Depth Channel Flow: Problem Solving
673
To calculate the flow rate for a trapezoidal channel, first, identify the bottom width, side slope, and flow depth of the channel. The cross-sectional area (A) corresponding to the depth of flow (y), channel bottom width (B), and side slope (θ) is determined by:Next, calculate the wetted perimeter, which includes the bottom width and the sloped side lengths in contact with the water. Using the values of the cross-sectional area and the wetted perimeter, determine the hydraulic radius by...
673
Orthogonal Trajectories
260
Orthogonal trajectories describe the geometric relationship between two families of curves that intersect each other at right angles. One illustrative case involves a family of parabolas that open sideways along the x-axis. These curves share a common shape but differ by a scaling parameter, resulting in a set of curves that all pass through the origin and widen at different rates.Determining Orthogonal TrajectoriesTo identify the orthogonal trajectories for these parabolas, the first step...
260
