Related Experiment Video
Updated: Sep 10, 2025

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
Published on: March 2, 2015
Neural network-based reinforcement learning for prescribed-time formation tracking of hybrid networked marine systems
Gao-Fei Zhao1, Tao Han1, Bo Xiao1
1School of Electrical Engineering and Automation, Hubei Normal University, Huangshi 435005, PR China.
Abstract:
This paper focuses on solving the time-varying formation tracking (TVFT) problem for surface-underwater hybrid networked marine systems (HNMSs) under denial of service (DoS) attacks and physical attacks. The system comprises multiple autonomous surface vehicles (ASVs) and autonomous underwater vehicles (AUVs). To address this challenge, a prescribed-time hierarchical control (PTHC) framework is proposed. For each follower, a prescribed-time distributed estimator is developed to estimate the states of leaders using relative information from neighboring agents, even in the presence of DoS attacks. To mitigate the effects of physical attacks, external disturbances, and unmodeled hydrodynamics, a reinforcement learning algorithm is incorporated into a neural network-based local controller, enabling time-varying formation tracking within a prescribed time. Using Lyapunov stability theory, sufficient conditions are established to guarantee the prescribed-time stability of the closed-loop system. Finally, simulations are conducted to validate the effectiveness and practicality of the proposed approach.
Related Concept Videos
Observational Learning
Avoidance Learning and Learned Helplessness
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Feedback control systems
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...

