Development and validation of a machine learning-based, point-of-care risk calculator for post-ERCP pancreatitis and

Todd Brenner1, Albert Kuo2, Christina J Sperna Weiland3

  • 1Division of Gastroenterology, Johns Hopkins Medical Institutions, Baltimore, Maryland, USA.

PubMed

Insights

A new machine learning tool accurately predicts post-ERCP pancreatitis (PEP) risk, helping clinicians select prophylaxis and monitoring strategies. This model identifies low-risk patients, potentially reducing unnecessary interventions.

Area of Science:

  • Gastroenterology and Hepatology
  • Medical Informatics
  • Machine Learning in Healthcare

Background:

  • Post-ERCP pancreatitis (PEP) poses a significant clinical challenge.
  • A robust risk prediction model for PEP is currently lacking.
  • Accurate risk stratification is crucial for guiding prophylactic interventions and patient monitoring.

Purpose of the Study:

  • To develop and validate a machine learning-based tool for predicting the risk of post-ERCP pancreatitis (PEP).
  • To aid clinical decision-making regarding periprocedural prophylaxis and postprocedural monitoring strategies.
  • To identify patients at low risk for PEP who may not require intensive monitoring.

Main Methods:

  • A gradient-boosted machine (GBM) model was developed using patient data from 12 randomized controlled trials.
  • Feature selection involved 20 PEP risk factors and 5 prophylactic interventions.
  • Model performance was evaluated using the area under the receiver operating curve (AUC) with cross-validation and a prospective pilot study.

Main Results:

  • The GBM model was trained on 7389 patients with an 8.6% PEP rate.
  • The model achieved an AUC of 0.70 during training and 0.74 in a prospective pilot study.
  • The model demonstrated a 95% negative predictive value, indicating high confidence in identifying low-risk patients.

Conclusions:

  • A novel machine learning tool for PEP risk estimation is feasible and useful.
  • The tool can effectively aid in selecting appropriate prophylactic measures.
  • High negative predictive value allows for confident identification of patients unlikely to develop PEP, optimizing resource allocation.
Abstract