Related Experiment Videos
Explainable time-series forecasting with sampling-free SHAP for Transformers
Matthias Hertel1, Sebastian Pütz2, Ralf Mikut2
1Institute for Automation and Applied Informatics (IAI), Karlsruhe Institute of Technology (KIT), Eggenstein-Leopoldshafen, Germany. matthias.hertel@kit.edu.
Abstract:
Time-series forecasting is essential for planning and decision-making across domains, and model explainability is critical for fostering user trust and satisfying transparency requirements. We introduce SHAPformer, an accurate, fast and explainable time-series forecasting model based on the Transformer architecture and Shapley Additive Explanations (SHAP). SHAPformer leverages attention manipulation to make predictions using feature subsets, thereby eliminating the need for sampling from background data required by established SHAP algorithms. As a result, it produces exact explanations in less than one second, achieving speedups of 50-1000 × compared to PermutationSHAP. On synthetic data with known ground-truth explanations, SHAPformer generates explanations that are true to the data. When applied to electrical load data and electricity price data, it achieves competitive predictive performance while providing meaningful local and global insights, including the identification of the past target as the key predictor and the detection of distinct load forecasting behavior during the Christmas period.
Related Concept Videos
Transformers in Distribution System
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
Sampling Continuous Time Signal
In the...
Transformers with Off-Nominal Turns Ratios
Transformers
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
Sampling Theorem
Sampling Plans
Random sampling is a method where each member of the population has an equal chance of being selected for the sample. It involves selecting individuals randomly, often using random number generators or lottery-type methods. For example, when analyzing the properties of a...