Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Collisions in Multiple Dimensions: Problem Solving01:06

Collisions in Multiple Dimensions: Problem Solving

4.4K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
4.4K
Elastic Collisions: Case Study01:15

Elastic Collisions: Case Study

14.4K
Elastic collision of a system demands conservation of both momentum and kinetic energy. To solve problems involving one-dimensional elastic collisions between two objects, the equations for conservation of momentum and conservation of internal kinetic energy can be used. For the two objects, the sum of momentum before the collision equals the total momentum after the collision. An elastic collision conserves internal kinetic energy, and so the sum of kinetic energies before the collision equals...
14.4K
Rolling Resistance: Problem Solving01:17

Rolling Resistance: Problem Solving

481
Rolling resistance, also known as rolling friction, is the force that resists the motion of a rolling object, such as a wheel, tire, or ball, when it moves over a surface. It is caused by the deformation of the object and the surface in contact with each other, as well as other factors like internal friction, hysteresis, and energy losses within the materials. Rolling resistance opposes the object's motion, requiring additional energy to overcome it and maintain movement. In practical...
481
Elastic Collisions: Introduction01:00

Elastic Collisions: Introduction

13.2K
An elastic collision is one that conserves both internal kinetic energy and momentum. Internal kinetic energy is the sum of the kinetic energies of the objects in a system. Truly elastic collisions can only be achieved with subatomic particles, such as electrons striking nuclei. Macroscopic collisions can be very nearly, but not quite, elastic, as some kinetic energy is always converted into other forms of energy such as heat transfer due to friction and sound. An example of a nearly...
13.2K
Types of Collisions - II01:19

Types of Collisions - II

8.2K
When two or more objects collide with each other, they can stick together to form one single composite object (after collision). The total mass of the object after the collision is the sum of the masses of the original objects, and it moves with a velocity dictated by the conservation of momentum. Although the system's total momentum remains constant, the kinetic energy decreases, and thus such a collision is an inelastic collision. Most of the collisions between objects in daily life are...
8.2K
Collisions in Multiple Dimensions: Introduction01:05

Collisions in Multiple Dimensions: Introduction

5.7K
It is far more common for collisions to occur in two dimensions; that is, the initial velocity vectors are neither parallel nor antiparallel to each other. Let's see what complications arise from this. The first idea is that momentum is a vector. Like all vectors, it can be expressed as a sum of perpendicular components (usually, though not always, an x-component and a y-component, and a z-component if necessary). Thus, when the statement of conservation of momentum is written for a...
5.7K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Electrospun Ti-Zr Oxide Heterostructures Enable Strongly Anchored Ultralow-Ir Anodes for Durable Acidic Oxygen Evolution.

Journal of the American Chemical Society·2026
Same author

A hybrid biofabrication platform for patient-specific aortic phantoms: from surgical rehearsal to device testing.

Computer assisted surgery (Abingdon, England)·2026
Same author

Sustainable Interfacial Evaporator Fabricated from Delignified Wood for Wastewater Treatment.

Langmuir : the ACS journal of surfaces and colloids·2026
Same author

Bronchoscopy-guided non-capping decannulation pathway versus conventional capping trial in patients with prolonged tracheostomy: a retrospective comparative cohort study.

Frontiers in medicine·2026
Same author

Progress in mechanistic and clinical translational research of endothelin A receptor antagonists in the treatment of diabetic kidney disease: a narrative review.

Frontiers in endocrinology·2026
Same author

An integrated approach to mining layout design for compound-hazards mines with coordinated rockburst and water inrush control.

Scientific reports·2026

Related Experiment Video

Updated: Sep 29, 2025

Operation of the Collaborative Composite Manufacturing CCM System
10:09

Operation of the Collaborative Composite Manufacturing CCM System

Published on: October 1, 2019

6.7K

A Novel Reinforcement Learning Collision Avoidance Algorithm for USVs Based on Maneuvering Characteristics and

Yunsheng Fan1,2, Zhe Sun1,2, Guofeng Wang1,2

  • 1College of Marine Electrical Engineering, Dalian Maritime University, Dalian 116026, China.

Sensors (Basel, Switzerland)
|March 26, 2022
PubMed
Summary

This study introduces a novel reinforcement learning collision avoidance (RLCA) algorithm for unmanned surface vehicles (USVs). The RLCA algorithm enables safe navigation by learning complex collision avoidance maneuvers without human input, adhering to international maritime regulations.

Keywords:
COLREGsautonomous collision avoidancedeep reinforcement learningunmanned surface vehicle

More Related Videos

A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants
06:28

A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants

Published on: August 26, 2018

6.1K
A Real-Time Interactive System for Studying Confrontational Pursuit Behavior in Rodents
06:25

A Real-Time Interactive System for Studying Confrontational Pursuit Behavior in Rodents

Published on: May 16, 2025

652

Related Experiment Videos

Last Updated: Sep 29, 2025

Operation of the Collaborative Composite Manufacturing CCM System
10:09

Operation of the Collaborative Composite Manufacturing CCM System

Published on: October 1, 2019

6.7K
A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants
06:28

A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants

Published on: August 26, 2018

6.1K
A Real-Time Interactive System for Studying Confrontational Pursuit Behavior in Rodents
06:25

A Real-Time Interactive System for Studying Confrontational Pursuit Behavior in Rodents

Published on: May 16, 2025

652

Area of Science:

  • Marine Robotics
  • Artificial Intelligence
  • Navigation Systems

Background:

  • Safe and efficient navigation of Unmanned Surface Vehicles (USVs) is critical.
  • Existing collision avoidance methods often lack adaptability and require human expertise.
  • International Regulations for Preventing Collisions at Sea (COLREGs) impose strict constraints on vessel maneuvers.

Purpose of the Study:

  • To develop an intelligent collision avoidance algorithm for USVs that complies with COLREGs.
  • To enable USVs to learn collision avoidance behaviors autonomously without prior human knowledge.
  • To enhance the safety and efficiency of USV navigation in complex marine environments.

Main Methods:

  • A Reinforcement Learning Collision Avoidance (RLCA) algorithm was proposed, utilizing a Double-DQN and dueling network architecture.
  • A category-based exploration method was developed to improve the agent's exploration capabilities.
  • A finite Markov Decision Process (MDP) was employed for agent training, incorporating USV maneuverability and COLREGs.
  • A transition discarding method was designed to optimize early training steps.

Main Results:

  • The RLCA algorithm demonstrated effective learning of collision avoidance motions without human pre-training.
  • The algorithm successfully reduced overestimation of the action-value function and improved state-action distinction.
  • Simulations in a marine environment showed the RLCA algorithm achieved a higher average reward in various USV encounter scenarios.
  • The algorithm effectively bridged the gap between navigation status and collision avoidance behavior.

Conclusions:

  • The proposed RLCA algorithm provides an intelligent and autonomous solution for USV collision avoidance.
  • The algorithm adheres to COLREGs and USV maneuverability constraints, ensuring safe and economical path planning.
  • This research contributes to the advancement of autonomous maritime navigation systems.