Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Second Order systems II01:18

Second Order systems II

137
In an underdamped second-order system, where the damping ratio ζ is between 0 and 1, a unit-step input results in a transfer function that, when transformed using the inverse Laplace method, reveals the output response. The output exhibits a damped sinusoidal oscillation, and the difference between the input and output is termed the error signal. This error signal also demonstrates damped oscillatory behavior. Eventually, as the system reaches a steady state, the error diminishes to zero.
137
Second Order systems I01:20

Second Order systems I

191
A servo system exemplifies a second-order system, featuring a proportional controller and load elements that ensure the output position aligns with the input position. The relationship between these components is described by a second-order differential equation. Applying the Laplace transform under zero initial conditions yields the transfer function, showing how inputs are converted to outputs in the system.
By reinterpreting the system, one can derive the closed-loop transfer function, which...
191
Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

133
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
133
Feedback control systems01:26

Feedback control systems

352
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
352
Time-Domain Interpretation of PD Control01:07

Time-Domain Interpretation of PD Control

147
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
147
Decision Making: P-value Method01:09

Decision Making: P-value Method

5.5K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim  is also stated. These statements can act as null and alternative hypotheses:  a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.5K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Contaminative Data-Driven Koopman Resilient Distributed Filtering for Unknown Stochastic Nonlinear Systems.

IEEE transactions on neural networks and learning systems·2026
Same author

Dissipativity-Based Output Feedback Control of Networked Sampled-Data Systems Under Actuator Failures and Consecutive DoS Attacks.

IEEE transactions on cybernetics·2026
Same author

Random Spatiotemporal Sampled-Data Control for Reaction-Diffusion Neural Networks With Dwell-Time-Based Sojourn Probability.

IEEE transactions on cybernetics·2026
Same author

Safe Reinforcement Learning for Nonlinear Multiagent Systems Based on Min-Max DMPC.

IEEE transactions on cybernetics·2026
Same author

Watermarking-Based Protection Strategy Against Stealthy Sensor Attacks on Zonotopic Set-Membership State Estimation.

IEEE transactions on cybernetics·2026
Same author

Stochastic-Sampling-Based Event-Triggered Control for Switching Reaction-Diffusion Neural Networks.

IEEE transactions on cybernetics·2026
Same journal

Relaxed Stability Conditions for Model Predictive Control of Hybrid Dynamical Systems Using Hybrid Recurrent Neural Networks.

IEEE transactions on cybernetics·2026
Same journal

An Evolutionary Algorithm Assisted by an Ensemble of Pareto-Optimal Surrogate Models.

IEEE transactions on cybernetics·2026
Same journal

A Quantum Self-Attention Neural Network Model on Quantum Circuits.

IEEE transactions on cybernetics·2026
Same journal

Semi-Explicit Solution of Some Discrete-Time Higher-Order-Cost Mean-Field-Type Control.

IEEE transactions on cybernetics·2026
Same journal

A Novel One-Step Small Object Detector for Autonomous Aerial Vehicles.

IEEE transactions on cybernetics·2026
Same journal

Online Data-Driven-Based Optimal Output Tracking Control Without Initial Stabilizing Policy.

IEEE transactions on cybernetics·2026
See all related articles

Related Experiment Video

Updated: Jul 26, 2025

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
08:18

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

Published on: August 15, 2020

5.0K

Data-Driven Optimal Bipartite Consensus Control for Second-Order Multiagent Systems via Policy Gradient Reinforcement

Qiwei Liu, Huaicheng Yan, Meng Wang

    IEEE Transactions on Cybernetics
    |June 12, 2023
    PubMed
    Summary
    This summary is machine-generated.

    This study introduces a data-driven optimal bipartite consensus control (OBCC) strategy for unknown multiagent systems (MASs). The method uses reinforcement learning to achieve consensus in agent states, even with varying computational abilities.

    More Related Videos

    Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
    11:54

    Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

    Published on: May 8, 2021

    4.5K
    The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy
    11:53

    The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy

    Published on: October 14, 2017

    11.7K

    Related Experiment Videos

    Last Updated: Jul 26, 2025

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
    08:18

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

    Published on: August 15, 2020

    5.0K
    Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
    11:54

    Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

    Published on: May 8, 2021

    4.5K
    The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy
    11:53

    The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy

    Published on: October 14, 2017

    11.7K

    Area of Science:

    • Control Systems Engineering
    • Artificial Intelligence
    • Robotics

    Background:

    • Multiagent systems (MASs) present challenges in achieving coordinated behavior, especially with unknown dynamics.
    • Bipartite consensus control is crucial for systems with both cooperative and competitive interactions.
    • Existing control strategies often struggle with asynchronous updates and varying agent capabilities.

    Purpose of the Study:

    • To address the optimal bipartite consensus control (OBCC) problem for unknown second-order discrete-time MASs.
    • To develop a data-driven distributed control strategy that ensures bipartite consensus.
    • To design an asynchronous control algorithm capable of handling heterogeneous computational abilities among agents.

    Main Methods:

    • Construction of a coopetition network to model agent interactions.
    • Application of distributed policy gradient reinforcement learning (RL) for optimal control strategy derivation.
    • Utilization of offline datasets generated in real-time for enhanced learning efficiency.
    • Implementation using an actor-critic neural network structure.
    • Stability and convergence analysis using functional analysis and Lyapunov theory.

    Main Results:

    • A data-driven distributed optimal control strategy was successfully obtained.
    • The proposed strategy guarantees bipartite consensus for both position and velocity states of agents.
    • The asynchronous algorithm effectively addresses computational heterogeneity within MASs.
    • Stability of the MAS and convergence of the learning process were rigorously analyzed.

    Conclusions:

    • The developed reinforcement learning-based OBCC strategy is effective for unknown discrete-time MASs.
    • The asynchronous and data-driven approach ensures robust bipartite consensus despite agent heterogeneity.
    • Numerical simulations validate the proposed method's effectiveness and performance.