Related Experiment Video
Updated: Jul 2, 2025

05:41
A Step-by-Step Implementation of DeepBehavior, Deep Learning Toolbox for Automated Behavior Analysis
Published on: February 6, 2020
9.4K
Deep Reinforcement Learning for Integration of Train Trajectory Optimization and Timetable Rescheduling Under
IEEE Transactions on Neural Networks and Learning Systems
|February 19, 2024
Summary
High-speed rail timetables can be disrupted by unexpected events. This study introduces an integrated approach for timetable rescheduling and train trajectory optimization, improving efficiency and feasibility.
Area of Science:
- Railway Engineering
- Operations Research
- Artificial Intelligence
Background:
- High-speed trains face disruptions from weather and equipment failures, causing delays.
- Increasing traffic density exacerbates delays, leading to timetable conflicts.
- Current hierarchical control systems are inefficient for real-time rescheduling.
Purpose of the Study:
- To develop an integrated model for timetable rescheduling and train trajectory optimization.
- To address inefficiencies in existing hierarchical train control systems.
- To ensure the efficiency and punctuality of high-speed railways.
Main Methods:
- An integrated model combining timetable rescheduling and trajectory optimization was formulated.
- Minimum running time was introduced into rescheduling, serving as the objective for trajectory optimization.
- A deep reinforcement learning (DRL)-based approach was employed to solve the integrated problem.
- Constraints included train overtaking, platform availability, and train priority.
Main Results:
- The proposed method successfully generated integrated rescheduled timetables and optimized train trajectories simultaneously.
- Numerical experiments on the Beijing-Shanghai high-speed railway demonstrated the method's effectiveness.
- Computation time increased linearly with problem size, indicating scalability.
Conclusions:
- The integrated approach overcomes limitations of hierarchical systems for high-speed rail rescheduling.
- Simultaneous optimization of timetables and trajectories enhances railway operational efficiency.
- DRL provides an effective solution for complex real-time railway management problems.
Related Concept Videos
Reinforcement Schedules
147
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
147
Multi-input and Multi-variable systems
106
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
106
Time-Domain Interpretation of PD Control
111
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
Consider the example of control of motor torque. Initially, a positive...
111
Controller Configurations
98
Controller configurations are crucial in a car's cruise control system because they manage speed over time to maintain a consistent pace regardless of road conditions, thereby meeting design goals. In traditional control systems, fixed-configuration design involves predetermined controller placement. System performance modifications are known as compensation.
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
98
Linear Approximation in Time Domain
81
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
81
PD Controller: Design
229
In automotive engineering, car suspension systems often employ Proportional Derivative (PD) controllers to enhance performance. PD controllers are utilized to adjust the damping force in response to road conditions. A controller, acting as an amplifier with a constant gain, demonstrates proportional control, with output directly mirroring input.
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
229

