Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Rolling Resistance: Problem Solving01:17

Rolling Resistance: Problem Solving

469
Rolling resistance, also known as rolling friction, is the force that resists the motion of a rolling object, such as a wheel, tire, or ball, when it moves over a surface. It is caused by the deformation of the object and the surface in contact with each other, as well as other factors like internal friction, hysteresis, and energy losses within the materials. Rolling resistance opposes the object's motion, requiring additional energy to overcome it and maintain movement. In practical...
469
Response Surface Methodology01:16

Response Surface Methodology

295
Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:
295
Reinforcement01:23

Reinforcement

362
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
362
Observational Learning01:12

Observational Learning

339
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
339
Statically Indeterminate Problem Solving01:16

Statically Indeterminate Problem Solving

511
Statically indeterminate problems are those where statics alone can not determine the internal forces or reactions. Consider a structure comprising two cylindrical rods made of steel and brass. These rods are joined at point B and restrained by rigid supports at points A and C. Now, the reactions at points A and C and the deflection at point B are to be determined. This rod structure is classified as statically indeterminate as the structure has more supports than are necessary for maintaining...
511
Relative Motion Analysis using Rotating Axes-Problem Solving01:29

Relative Motion Analysis using Rotating Axes-Problem Solving

456
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
456

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Agentic and LLM-Based Multimodal Anomaly Detection: Architectures, Challenges, and Prospects.

Sensors (Basel, Switzerland)·2026
Same author

Adaptive Bayesian learning for stability characterization of re-entry vehicles.

Scientific reports·2026
Same author

Macrophages in human atherosclerotic plaques in the era of single-cell and spatial transcriptomics.

ImmunoHorizons·2026
Same author

Editorial: Metabolism in the tumour microenvironment: implications for pathogenesis and therapeutics.

Frontiers in immunology·2026
Same author

The evolution of digital twins from reactive to agentic systems.

Nature computational science·2026
Same author

Digital twin syncing for autonomous surface vessels using reinforcement learning and nonlinear model predictive control.

Scientific reports·2025

Related Experiment Video

Updated: Sep 24, 2025

A Step-by-Step Implementation of DeepBehavior, Deep Learning Toolbox for Automated Behavior Analysis
05:41

A Step-by-Step Implementation of DeepBehavior, Deep Learning Toolbox for Automated Behavior Analysis

Published on: February 6, 2020

9.5K

Risk-based implementation of COLREGs for autonomous surface vehicles using deep reinforcement learning.

Amalie Heiberg1, Thomas Nakken Larsen2, Eivind Meyer3

  • 1Equinor, Norway.

Neural Networks : the Official Journal of the International Neural Network Society
|May 2, 2022
PubMed
Summary

Autonomous marine vessels use deep reinforcement learning to navigate safely and efficiently. This system integrates International Regulations for Preventing Collisions at Sea (COLREGs) for robust path following and collision avoidance.

Keywords:
Autonomous surface vehicleCollision avoidanceCollision risk indicesDeep reinforcement learningMachine learning controllerPath following

More Related Videos

A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants
06:28

A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants

Published on: August 26, 2018

6.1K
An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice
08:59

An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice

Published on: March 3, 2023

2.2K

Related Experiment Videos

Last Updated: Sep 24, 2025

A Step-by-Step Implementation of DeepBehavior, Deep Learning Toolbox for Automated Behavior Analysis
05:41

A Step-by-Step Implementation of DeepBehavior, Deep Learning Toolbox for Automated Behavior Analysis

Published on: February 6, 2020

9.5K
A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants
06:28

A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants

Published on: August 26, 2018

6.1K
An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice
08:59

An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice

Published on: March 3, 2023

2.2K

Area of Science:

  • Marine engineering
  • Artificial intelligence
  • Robotics

Background:

  • Autonomous marine vessels are increasingly adopted for efficiency and environmental benefits.
  • Ensuring safety and adherence to maritime rules (COLREGs) is critical for autonomous navigation.
  • Traditional control systems struggle with the ambiguity of COLREGs and complex scenarios.

Purpose of the Study:

  • To develop a versatile, robust, and reliable control system for autonomous marine vessels.
  • To integrate International Regulations for Preventing Collisions at Sea (COLREGs) into an autonomous navigation system.
  • To enable autonomous vessels to dynamically balance path following with COLREG-compliant collision avoidance.

Main Methods:

  • Utilized deep reinforcement learning (DRL), a model-free machine learning approach.
  • Incorporated a subset of COLREGs into the DRL system using collision risk theory.
  • Trained and tested the system in various scenarios, including isolated encounters and AIS-based simulations.

Main Results:

  • The DRL-based system successfully integrated COLREGs for path following and obstacle avoidance.
  • The autonomous agent dynamically adjusted its behavior between path following and collision avoidance.
  • The system demonstrated effectiveness in simulated real-world scenarios.

Conclusions:

  • Deep reinforcement learning offers a promising solution for autonomous marine vessel control.
  • The developed system provides a pathway for autonomous vessels to navigate safely and adhere to maritime regulations.
  • This approach addresses the challenges of interpreting and implementing COLREGs in autonomous systems.