Prediction uncertainty of density functional approximations for properties of crystals with cubic symmetry

The performance of a method is generally measured by an assessment of the errors between the method's results and a set of reference data. The prediction uncertainty is a measure of the confidence that can be attached to a method's prediction. Its estimation is based on the random part of the errors not explained by reference data uncertainty, which implies an evaluation of the systematic component(s) of the errors. As the predictions of most density functional approximations (DFA) present systematic errors, the standard performance statistics, such as the mean of the absolute errors (MAE or MUE), cannot be directly used to infer prediction uncertainty. We investigate here an a posteriori calibration method to estimate the prediction uncertainty of DFAs for properties of solids. A linear model is shown to be adequate to address the systematic trend in the errors. The applicability of this approach to modest-size reference sets (28 systems) is evaluated for the prediction of band gaps, bulk moduli, and lattice constants with a wide panel of DFAs.