Jove
Visualize
Contact Us

Related Concept Videos

Hierarchy of Motor Control01:18

Hierarchy of Motor Control

5.9K
The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
5.9K
Controller Configurations01:22

Controller Configurations

352
Controller configurations are crucial in a car's cruise control system because they manage speed over time to maintain a consistent pace regardless of road conditions, thereby meeting design goals. In traditional control systems, fixed-configuration design involves predetermined controller placement. System performance modifications are known as compensation.
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
352
Feedback control systems01:26

Feedback control systems

687
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
687
Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

392
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
392
PD Controller: Design01:26

PD Controller: Design

624
In automotive engineering, car suspension systems often employ Proportional Derivative (PD) controllers to enhance performance. PD controllers are utilized to adjust the damping force in response to road conditions. A controller, acting as an amplifier with a constant gain, demonstrates proportional control, with output directly mirroring input.
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
624
Root-Locus Method01:19

Root-Locus Method

479
A cruise control system in a car is designed to maintain a specified speed automatically by adjusting the gas pedal. The system continuously measures the vehicle's speed and makes fine adjustments to the pedal to achieve this goal. The root locus method is particularly useful for understanding how the cruise control system's behavior changes under varying conditions, such as when the car goes uphill, downhill, or faces strong wind resistance.
This system can be represented by a block...
479

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Metagenomic and genomic characterization of extrapulmonary Mycobacterium abscessus infections: a comparative cohort study.

BMC infectious diseases·2026
Same author

Investigating the Mechanism of Rare-Earth Ion Incorporation into Glass-Ceramic Crystal Phases through Er<sup>3+</sup> Ion Probe Characteristics.

Nanomaterials (Basel, Switzerland)·2024
See all related articles
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Jan 16, 2026

Evaluation of an Exclusive Spur Dike U-Turn Design with Radar-Collected Data and Simulation
11:41

Evaluation of an Exclusive Spur Dike U-Turn Design with Radar-Collected Data and Simulation

Published on: February 1, 2020

20.8K

Hierarchical reinforcement learning-based traffic signal control.

Jiajing Shen1

  • 1School of Computer Science and Technology, Tongji University, Shanghai, 201804, China. sngjiajing@tongji.edu.cn.

Scientific Reports
|September 25, 2025
PubMed
Summary
This summary is machine-generated.

This study introduces SHLight, a hierarchical deep reinforcement learning method for traffic light control. SHLight improves urban traffic flow by coordinating local intersection agents for better global efficiency.

Keywords:
Hierarchical deep reinforcement learningIntelligent traffic signal controlMulti-agent reinforcement learning

More Related Videos

Evaluating the Effect of Roadside Parking on a Dual-Direction Urban Street
14:55

Evaluating the Effect of Roadside Parking on a Dual-Direction Urban Street

Published on: January 20, 2023

4.2K
Experimental Investigation of the Hierarchical Control in DC Microgrids Using a Real-time Simulator
06:04

Experimental Investigation of the Hierarchical Control in DC Microgrids Using a Real-time Simulator

Published on: February 14, 2025

1.0K

Related Experiment Videos

Last Updated: Jan 16, 2026

Evaluation of an Exclusive Spur Dike U-Turn Design with Radar-Collected Data and Simulation
11:41

Evaluation of an Exclusive Spur Dike U-Turn Design with Radar-Collected Data and Simulation

Published on: February 1, 2020

20.8K
Evaluating the Effect of Roadside Parking on a Dual-Direction Urban Street
14:55

Evaluating the Effect of Roadside Parking on a Dual-Direction Urban Street

Published on: January 20, 2023

4.2K
Experimental Investigation of the Hierarchical Control in DC Microgrids Using a Real-time Simulator
06:04

Experimental Investigation of the Hierarchical Control in DC Microgrids Using a Real-time Simulator

Published on: February 14, 2025

1.0K

Area of Science:

  • Artificial Intelligence
  • Transportation Engineering
  • Computer Science

Background:

  • Efficient traffic light control is crucial for urban mobility.
  • Deep Reinforcement Learning (DRL) shows promise for real-time traffic management.
  • Current DRL methods often optimize local intersections independently, hindering global traffic flow.

Purpose of the Study:

  • To develop an advanced DRL framework for traffic light control that optimizes both local and global traffic efficiency.
  • To address the limitations of independent agents in state-of-the-art DRL traffic control systems.

Main Methods:

  • Proposed SHLight (Sample selection-based Hierarchical traffic Light control method), a hierarchical RL framework with manager and worker agents.
  • Partitioned traffic networks into regions managed by manager agents overseeing worker agents (traffic signal controllers).
  • Implemented importance sampling to address non-stationarity and auxiliary actions to improve observability in hierarchical RL.

Main Results:

  • SHLight demonstrated superior performance compared to state-of-the-art models in simulations.
  • Achieved significant reductions in traffic queue lengths.
  • Demonstrated notable decreases in vehicle waiting times and overall delays.

Conclusions:

  • SHLight offers an effective hierarchical approach to enhance urban traffic signal control.
  • The method successfully balances local and global objectives for improved traffic efficiency.
  • SHLight presents a promising advancement in intelligent transportation systems using DRL.