基于DQN算法,优化大型货运列车车库的变动运营计划
Jiandong Qiu1, Shusheng Xu1, Minan Tang2
1School of Mechanical Engineering, Lanzhou Jiaotong University, Lanzhou, China.
PloS one
|April 8, 2025
概括
这项研究引入了深度强化学习 (DRL) 方法,以优化货运列车变流操作. 深度Q网络 (DQN) 算法显著减少了变流,并提高了火车车库的效率.
科学领域:
- 铁路运营研究 铁路运营研究
- 交通运输中的人工智能
- 优化物流的优化物流.
背景情况:
- 货运列车车库的变速运行非常重要,这会影响铁路的整体效率.
- 优化变流计划对于提高生产和运输吞吐量至关重要.
- 目前的方法可能无法完全解决变流操作的复杂性.
研究的目的:
- 开发和验证一个深度强化学习 (DRL) 模型,以优化变流操作.
- 为了尽量减少列车重组所需的变流的数量.
- 为了提高大型货运列车车库中变流操作的效率和智能性.
主要方法:
- 构建了一个DRL环境,定义了移动操作的动作,状态和奖励.
- 利用了Deep Q网络 (DQN) 算法,以分流机车作为代理.
- 设计了一个奖励函数,该函数基于在重组后生成的总分流.
主要成果:
- 与整体规划和协调 (OPC) 和二进制搜索树 (BST) 算法相比,DQN显著减少了变位的数量.
- 由DQN生成的计划占用了更少的车道,并且比OPC减少了10%的变动.
- 在解决时间和减少合/滑动操作方面,DQN的表现优于Branch and Bound (B&B),这表明计划质量优越.
结论:
- DQN算法提供了一个有效和智能解决方案,用于优化货运列车车库的分流操作.
- DRL提供了一种有希望的方法来提高铁路物流的效率和降低运营成本.
- 这项研究为复杂的变流任务的智能自动化提供了一种新的方法.
相关概念视频
01:22Block Diagram Reduction
142
The process of deriving the transfer function of a control system often involves reducing its block diagram to a single block. This simplification can be achieved through a series of strategic operations, including relocating branch points and comparators. These operations preserve the overall function of the system while allowing for easier manipulation and combination of blocks.
The first step in this process is the identification and relocation of a branch point. A branch point, where a...
The first step in this process is the identification and relocation of a branch point. A branch point, where a...
142
01:25Multimachine Stability
115
Multimachine stability analysis is crucial for understanding the dynamics and stability of power systems with multiple synchronous machines. The objective is to solve the swing equations for a network of M machines connected to an N-bus power system.
In analyzing the system, the nodal equations represent the relationship between bus voltages, machine voltages, and machine currents. The nodal equation is given by:
In analyzing the system, the nodal equations represent the relationship between bus voltages, machine voltages, and machine currents. The nodal equation is given by:
115
01:29Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
34
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
34
01:07Time-Domain Interpretation of PD Control
74
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
Consider the example of control of motor torque. Initially, a positive...
74