深度强化学习模型用于多艘飞船避免碰撞的决策设计实施和性能分析分析
Rongjun Pan1, Wei Zhang2, Shijie Wang1
1School of Navigation, GongQing Institute of Science and Technology, Jiujiang, 332020, Jiangxi, China.
Scientific reports
|July 2, 2025
概括
本研究引入了深度强化学习 (DRL) 模型,用于避免多艘船的碰撞,显著降低碰撞率并改善海上航行中的安全距离.
科学领域:
- 海上安全的航行.
- 人工智能的人工智能
- 机器人技术 机器人技术 机器人技术
背景情况:
- 避免碰撞对于海上安全至关重要.
- 现有的方法难以处理复杂的多艘船的场景.
- 在自主导航中需要智能决策.
研究的目的:
- 开发一种新的深度强化学习 (DRL) 模型,用于避免多艘船的碰撞.
- 在复杂的海上环境中提高航行效率和合规性.
- 在碰撞预防和可扩展性方面超越现有的DRL方法.
主要方法:
- 开发了一个DRL模型,具有全面的状态表示和动态奖励函数.
- 集成了一个增强的DQN架构,包括对决网络和双重Q学习.
- 特别针对海上碰撞避免场景优化模型.
主要成果:
- 与最先进的多剂DRL相比,实现了与碰撞率的30.8%的降低.
- 提高了20%的安全距离,并加强了监管合规性.
- 在高密度流量中表现出卓越的可扩展性,性能降低最小 (12.6%).
结论:
- 拟议的DRL模型在自主船舶避免碰撞方面取得了重大进展.
- 该模型有效平衡了安全性,效率和监管合规性.
- 这种方法为加强海上安全和自主航行提供了强大的解决方案.
相关概念视频
Collisions in Multiple Dimensions: Problem Solving
4.4K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
4.4K
Multi-input and Multi-variable systems
152
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
152
Collisions in Multiple Dimensions: Introduction
5.6K
It is far more common for collisions to occur in two dimensions; that is, the initial velocity vectors are neither parallel nor antiparallel to each other. Let's see what complications arise from this. The first idea is that momentum is a vector. Like all vectors, it can be expressed as a sum of perpendicular components (usually, though not always, an x-component and a y-component, and a z-component if necessary). Thus, when the statement of conservation of momentum is written for a...
5.6K
Elastic Collisions: Case Study
14.4K
Elastic collision of a system demands conservation of both momentum and kinetic energy. To solve problems involving one-dimensional elastic collisions between two objects, the equations for conservation of momentum and conservation of internal kinetic energy can be used. For the two objects, the sum of momentum before the collision equals the total momentum after the collision. An elastic collision conserves internal kinetic energy, and so the sum of kinetic energies before the collision equals...
14.4K
Avoidance Learning and Learned Helplessness
1.9K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.9K
Modeling and Similitude
344
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
344


