Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Modeling and Similitude01:12

Modeling and Similitude

165
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
165
Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

93
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
93
Typical Model Studies01:30

Typical Model Studies

211
Fluid mechanics model studies often utilize scaled-down systems to predict fluid behavior in full-scale environments, such as river flows, dam spillways, and structures interacting with open surfaces. Maintaining Froude number similarity in river models is crucial, as it replicates surface flow features like wave patterns and velocities.
211
Feedback control systems01:26

Feedback control systems

262
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
262
Time-Domain Interpretation of PD Control01:07

Time-Domain Interpretation of PD Control

77
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
77
Controller Configurations01:22

Controller Configurations

79
Controller configurations are crucial in a car's cruise control system because they manage speed over time to maintain a consistent pace regardless of road conditions, thereby meeting design goals. In traditional control systems, fixed-configuration design involves predetermined controller placement. System performance modifications are known as compensation.
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
79

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Agentic and LLM-Based Multimodal Anomaly Detection: Architectures, Challenges, and Prospects.

Sensors (Basel, Switzerland)·2026
Same author

Real-Time Predictive Condition Monitoring Using Multivariate Data.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2024
Same author

Unsupervised Anomaly Detection for IoT-Based Multivariate Time Series: Existing Solutions, Performance Analysis and Future Directions.

Sensors (Basel, Switzerland)·2023
Same journal

Therapeutic potential of crude protein extracts from two Egyptian freshwater snails Lanistes carinatus and Bellamya unicolor.

Scientific reports·2026
Same journal

Microbial contamination of donor corneas and post-keratoplasty endophthalmitis: a comparison between Japanese and U.S. eye banks using cold storage.

Scientific reports·2026
Same journal

Prevalence and contributing factors of virological non-suppression among adult patients on first-line antiretroviral therapy in tertiary hospitals in Ethiopia.

Scientific reports·2026
Same journal

An in vitro comparison of color stability between alkasite and different restorative materials in various staining solutions.

Scientific reports·2026
Same journal

Toward accessible mRNA LNP formulation: systematic evaluation of mixing strategies and key parameters.

Scientific reports·2026
Same journal

A network analysis of personality traits, mentalizing, and psychological health in Chinese college students.

Scientific reports·2026
See all related articles

Related Experiment Video

Updated: May 21, 2025

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
07:46

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

Published on: August 9, 2024

603

Digital twin syncing for autonomous surface vessels using reinforcement learning and nonlinear model predictive

Henrik Stokland Berg1, Daniel Menges1, Trym Tengesdal1

  • 1Department of Engineering Cybernetics, Norwegian University of Science and Technology, Trondheim, Norway.

Scientific Reports
|March 19, 2025
PubMed
Summary
This summary is machine-generated.

This study introduces adaptive control for autonomous surface vessels (ASVs) using deep reinforcement learning (DRL) and nonlinear model predictive control (NMPC). This enhances ASV reliability and digital twin synchronization in dynamic maritime environments.

Keywords:
Autonomous surface vesselDeep reinforcement learningModel identificationNonlinear model predictive controlParameter optimization

More Related Videos

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

4.3K
Optimization, Test and Diagnostics of Miniaturized Hall Thrusters
12:22

Optimization, Test and Diagnostics of Miniaturized Hall Thrusters

Published on: February 16, 2019

8.9K

Related Experiment Videos

Last Updated: May 21, 2025

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
07:46

Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

Published on: August 9, 2024

603
Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

4.3K
Optimization, Test and Diagnostics of Miniaturized Hall Thrusters
12:22

Optimization, Test and Diagnostics of Miniaturized Hall Thrusters

Published on: February 16, 2019

8.9K

Area of Science:

  • Maritime robotics
  • Control engineering
  • Artificial intelligence

Background:

  • Current autonomous surface vessel (ASV) control systems struggle with model uncertainties and parameter variations.
  • This limitation compromises ASV reliability in complex, dynamic maritime conditions, necessitating adaptive solutions.

Purpose of the Study:

  • To develop an integrated deep reinforcement learning (DRL) and nonlinear model predictive control (NMPC) approach for ASV control.
  • To ensure continuous synchronization between the ASV's digital twin and its physical counterpart for enhanced accuracy and adaptability.
  • To optimize ASV control performance and identify unknown model parameters in real-time.

Main Methods:

  • Integration of DRL for optimizing NMPC parameters and identifying unknown model parameters.
  • Utilizing digital twins for risk-free training of control agents in simulated maritime environments.
  • Real-time parameter identification and NMPC tuning via DRL.

Main Results:

  • Demonstrated effectiveness of the DRL-NMPC approach in improving ASV control performance.
  • Enhanced reliability and adaptability of ASVs under dynamic and uncertain maritime conditions.
  • Successful synchronization of digital twins with physical ASVs, validated through extensive simulations.

Conclusions:

  • The proposed DRL-NMPC framework significantly enhances ASV safety, efficiency, and reliability.
  • This approach provides a robust solution for ASV control challenges in dynamic environments.
  • The study lays the groundwork for advanced autonomous maritime navigation and control systems.