Related Experiment Videos
Uncertainty quantification in train delay prediction with conformal prediction
Rui Luo1, Xiaoyi Su1, Khuong An Nguyen2
1Department of Systems Engineering, City University of Hong Kong , Hong Kong.
Abstract:
Predicting train delays is crucial for railway operations and passenger experience, but point predictions fail to capture uncertainty, limiting their use in risk-aware decisions. Existing uncertainty quantification (UQ) methods often rely on unverifiable assumptions and produce miscalibrated intervals. This paper evaluates conformal prediction (CP) as a distribution-free framework for generating prediction intervals with rigorous coverage guarantees. Using a large-scale dataset from Southeastern Railway in the UK, we show that UQ methods such as quantile regression (QR), Monte Carlo dropout and deep ensembles (DE) frequently under- or over-cover nominal levels. By contrast, CP corrects miscalibration across models, ensuring valid marginal coverage. Conformalized QR (CQR) achieves the best efficiency by producing adaptively sized intervals while maintaining calibration. To address heterogeneity across stations, we apply Mondrian CP (MCP), which enforces conditional coverage within strata. Empirical results confirm MCP delivers reliable intervals for each subgroup. Our work demonstrates that CP is a model-agnostic, robust framework for trustworthy UQ, offering a practical pathway to reliable risk assessment in transportation and other high-stakes domains. This article is part of the theme issue 'Advancing uncertainty quantification in AI systems'.
Related Concept Videos
Propagation of Uncertainty from Random Error
Uncertainty: Confidence Intervals
Prediction Intervals
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
The...
Propagation of Uncertainty from Systematic Error
Uncertainty: Overview
The Uncertainty Principle