Related Experiment Video
Updated: Nov 6, 2025

Large Scale Energy Efficient Sensor Network Routing Using a Quantum Processor Unit
Published on: September 8, 2023
An eco-driving algorithm for trains through distributing energy: A Q-Learning approach
Qingyang Zhu1, Shuai Su1, Tao Tang2
1State Key Laboratory of Rail Traffic Control and Safety, Beijing Jiaotong University, Beijing, 100044, China; The Center of National Railway Intelligent Transportation System Engineering and Technology, China Academy of Railway Sciences Corporation Limited, 100081, China.
Abstract:
The energy-efficient train operation methodology is the focus of this paper, and a Q-Learning-based eco-driving approach is proposed. Firstly, the core idea of energy-distribution-based method (EDBM) that converts the eco-driving problem to the finite Markov decision process is presented. Secondly, Q-Learning approach is proposed to determine the optimal energy distribution policy. Specifically, two different state definitions, i.e., trip-time-relevant (TT) and energy-distribution-relevant (ED) state definitions, are introduced. Finally, the effectiveness of the proposed approach is verified in a deterministic and a stochastic environment. It is also illustrated that TT-state approach takes about 20 times more computation time compared with ED-state approach while the space complexity of TT-state approach is nearly constant. The hyperparameter sensitivity analysis demonstrates the robustness of the proposed approach.
Related Concept Videos
Rolling Resistance: Problem Solving
Distributed Loads: Problem Solving
Energy to Drive Translocation
Generally, polypeptides are unfolded by two distinct...
Energy Line and Hydraulic Gradient Line
Energy Conservation and Bernoulli's Equation
All the terms in the equation have the dimension of energy per unit volume. The kinetic energy per unit volume is called the kinetic energy density, and the potential energy per unit volume is...
Transformers in Distribution System
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
