Related Experiment Videos
DQN-Based Adaptive Intersection Control for Warehouse AGVs in SUMO with a Proposed VLC Architecture
Paula Louro1,2, Gonçalo Galvão1,2,3, Susana Amaral1
1Instituto Superior de Engenharia de Lisboa (ISEL), Universidade Politécnica de Lisboa, R. Conselheiro Emídio Navarro, 1959-007 Lisboa, Portugal.
Abstract:
Congestion at shared intersections can limit the scalability of Automated Guided Vehicle (AGV) fleets in high-density warehouses. This study evaluates a Deep Q-Network (DQN) controller for adaptive intersection management in a SUMO-based warehouse model with five crossings, including the shared central crossing CP1. After one 200-episode training run, the DQN was evaluated in three seeded 6200 s simulations per demand scenario. Against a study-specific cyclic fixed-time controller at 250, 350, and 400 AGVs/h, the DQN achieved unweighted mean reductions of 62.9% in signal queue, 59.1% in average waiting time, and 18.0% in AGVs waiting to load, while loading/unloading occupancy changed by less than 1%. A matched 750 AGVs/h stress test showed that the benefit did not persist after saturation: at CP1, the mean signal queue increased from 13.15 to 30.68 AGVs and the mean number waiting to load from 9.64 to 15.93 AGVs. Sustained CP1 congestion began between 350 and 400 AGVs/h for the tested layout. Retained test outputs quantify test-level dispersion, but the single training run cannot estimate training variability. These results quantify the DQN traffic-control policy under ideal availability of SUMO state information and do not validate a VLC system. VLC is presented separately as a proposed future implementation layer; communication delay, packet loss, occlusion, and other physical-channel effects were not modelled.
Related Concept Videos
Distributed Loads: Problem Solving
Control Systems: Applications
In modern vehicles, control systems manage various functions to enhance performance and safety. The steering wheel and accelerator are primary inputs in a car's control system. The direction...
PD Controller: Design
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
Control Systems
At the heart...
Control System Problem
When forming a closed-loop system, issues can arise if the poles cross into the unstable region, leading to potential...
Open and closed-loop control systems
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal and...