Related Experiment Video
Updated: Aug 28, 2026

Expedited Radiation Biodosimetry by Automated Dicentric Chromosome Identification (ADCI) and Dose Estimation
Published on: September 4, 2017
CP4SBI: local conformal calibration of credible sets in simulation-based inference
Luben Miguel Cruz Cabezas1,2,3, Vagner Silva Santos1, Thiago Rodrigo Ramos1
1Department of Statistics, Federal University of Sao Carlos , São Carlos, São Paulo, Brazil.
Abstract:
Current experimental scientists have been increasingly relying on simulation-based inference (SBI) to invert complex nonlinear models with intractable likelihoods. However, posterior approximations obtained with SBI are often miscalibrated, causing credible regions to undercover true parameters. We develop CP4SBI, a model-agnostic conformal calibration framework that constructs credible sets with local Bayesian coverage. Our two proposed variants, namely local calibration via regression trees and cumulative distribution function CDF-based calibration, enable finite-sample local coverage guarantees for any scoring function, including highest posterior density (HPD), symmetric and quantile-based regions. Experiments on widely used SBI benchmarks demonstrate that our approach improves the quality of uncertainty quantification for neural posterior estimators (NPEs) using both normalizing flows and score-diffusion modelling. This article is part of the theme issue 'Advancing uncertainty quantification in AI systems'.
Related Concept Videos
Calibration Curves: Correlation Coefficient
Interpretation of Confidence Intervals
Confidence intervals have confidence coefficients that are crucial for their interpretation. The most common confidence coefficients are 0.90, 0.95, and 0.99, which can be written as percentages–90%, 95%, and 99%, respectively.
Suppose a person calculates a confidence interval with a confidence coefficient of 0.95. In that case, they can...
