Uncertainty-Aware Explainable AI for Pancreatic Cysts: Identifying Deep Learning Vulnerabilities and Ensuring Safe...

Despite growing interest in AI for pancreatic cyst management, no prior study has systematically investigated how lesion characteristics influence model behavior or provided a comprehensive explainability analysis in IPMN malignancy risk stratification. We present the first multi-center study integrating explainable AI with uncertainty quantification to evaluate how cyst type, size, and location affect deep learning performance in IPMN malignancy prediction. Our retrospective study analyzed 170 IPMNs from seven centers using a radiomics-deep learning fusion model. Cases were stratified by dysplasia grade, IPMN type, size, and location; with model interpretability assessed using SHAP, LIME, Grad-CAM, and uncertainty quantification. Overall accuracy was 67.1%, with model uncertainty lower for correct versus incorrect predictions (0.72 vs 0.78, p < 0.001). On subgroup analysis: Low-Risk lesion accuracy exceeded High-Risk (81.3% vs. 42.9%, p < 0.001), BD accuracy was inversely correlated with cyst size while MD remained stable, and body and whole-pancreas cysts stratified more accurately than tail cysts (77.8%, 76.6% vs. 47.8%). AI models face significant, previously uncharacterized performance drops when evaluating complex high-risk IPMNs. Our study shows that integrating uncertainty quantification can successfully flag unreliable predictions, enabling a selective-prediction framework where clinicians can confidently rely on AI for low-risk, low-uncertainty lesions while deferring high-uncertainty cases to expert review.