深度强化学习用于集成列车轨道优化和时间表在干扰下重新安排
IEEE transactions on neural networks and learning systems
|February 19, 2024
概括
高速铁路的时间表可能会因意外事件而受到干扰. 本研究引入了一种综合方法,用于重新安排时间表和优化列车轨迹,提高效率和可行性.
科学领域:
- 铁路工程 铁路工程是指铁路工程.
- 运营研究 运营研究
- 人工智能的人工智能
背景情况:
- 高速列车面临天气和设备故障的干扰,导致延误.
- 交通密度的增加加剧了延误,导致时间表冲突.
- 当前的层次控制系统对于实时重新安排是低效的.
研究的目的:
- 开发一个综合模型,用于时间表调度和列车轨道优化.
- 为了解决现有的层次列车控制系统的低效率问题.
- 确保高速铁路的效率和准时性.
主要方法:
- 制定了一个综合模型,将时间表重新安排和轨迹优化结合起来.
- 在重新安排中引入了最小运行时间,作为轨迹优化的目标.
- 基于深度强化学习 (DRL) 的方法被用来解决综合问题.
- 限制包括列车超车,平台可用性和列车优先级.
主要成果:
- 提出的方法成功地同时生成了集成的重新调度时间表和优化列车轨迹.
- 北京-上海高速铁路上的数值实验证明了该方法的有效性.
- 计算时间随着问题大小的线性增加,表明可扩展性.
结论:
- 综合方法克服了对高速铁路重新调度等级系统的局限性.
- 同时优化时间表和轨迹可提高铁路运营效率.
- DRL为复杂的实时铁路管理问题提供了有效的解决方案.
相关概念视频
Reinforcement Schedules
147
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
147
Multi-input and Multi-variable systems
106
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
106
Time-Domain Interpretation of PD Control
111
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
Consider the example of control of motor torque. Initially, a positive...
111
Controller Configurations
98
Controller configurations are crucial in a car's cruise control system because they manage speed over time to maintain a consistent pace regardless of road conditions, thereby meeting design goals. In traditional control systems, fixed-configuration design involves predetermined controller placement. System performance modifications are known as compensation.
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
98
Linear Approximation in Time Domain
81
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
81
PD Controller: Design
229
In automotive engineering, car suspension systems often employ Proportional Derivative (PD) controllers to enhance performance. PD controllers are utilized to adjust the damping force in response to road conditions. A controller, acting as an amplifier with a constant gain, demonstrates proportional control, with output directly mirroring input.
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
229


