Related Experiment Videos
Dual-mode deep reinforcement learning for safety-oriented MASS collision avoidance
Yifan Du1, Feixiang Zhu2,3, Moxuan Wei1
1Navigation College, Dalian Maritime University, Dalian, 116026, China.
Abstract:
Safe collision avoidance for Maritime Autonomous Surface Ships (MASS) remains challenging because autonomous controllers must maintain predictable rule-guided behaviour while adapting to dense and uncertain traffic situations. This research introduces a dual-mode, safety-oriented deep reinforcement learning (DRL) framework that integrates model-based predictability with data-driven adaptability for MASS collision avoidance. Encounter scenarios are quantified in accordance with the International Regulations for Preventing Collisions at Sea (COLREGs), and a multi-objective reward function combines pairwise rule-guided reasoning with dynamic risk awareness. In the routine-navigation mode, Proximal Policy Optimisation (PPO) is employed to generate stable and COLREGs-guided trajectories, whilst the heightened-safety mode applies a tree-based safety filter that prunes unsafe actions and supports autonomous switching under elevated close-quarters risk. Two pruning optimisations-Reachable Envelope Pruning (REP) and the Terminal Safety Criterion (TSC)-jointly reduce node expansions by over 90%, thereby markedly improving computational efficiency. Simulation results demonstrate that the safety layer achieved no observed collisions in two-ship encounters and reduced collision rates by approximately 80-90% in congested multi-ship scenarios compared with the routine-navigation PPO baseline without the heightened-safety mode. Even in six-ship traffic, the agent maintains an average minimum passing distance exceeding 0.5 nautical miles. Latency analysis indicates reduced computational overhead under the tested simulation settings, suggesting the decision-level computational feasibility of the proposed framework.
Related Concept Videos
Collisions in Multiple Dimensions: Problem Solving
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
Collisions in Multiple Dimensions: Introduction
Types of Collisions - II
Avoidance Learning and Learned Helplessness
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Types Of Collisions - I
Elastic Collisions: Case Study