The crucial role of machine learning models in predicting current childhood asthma: model comparison, calibration,

Aditya Chakraborty1, A K M Raquibul Bashar2

  • 1Department of Epidemiology, Biostatistics and Environmental Health, Joint School of Public Health, Old Dominion University, Norfolk, VA, United States.

Insights

This study developed predictive models for early asthma diagnosis in children. The XGBoost model showed the highest accuracy, while the random forest model offered the best sensitivity for initial screening.

Area of Science:

  • Pediatric pulmonology
  • Health informatics
  • Biostatistics

Background:

  • Asthma is a significant chronic childhood illness, particularly challenging to diagnose in young children.
  • Predictive models offer potential for early diagnosis, personalized treatments, and understanding disease progression.
  • This study leverages national data to build and compare predictive models for asthma.

Purpose of the Study:

  • To develop and compare high-performing analytical predictive models for asthma diagnosis.
  • To identify key risk factors and influential predictors of asthma in children.
  • To improve early detection and management strategies for pediatric asthma.

Main Methods:

  • Analysis of the 2011-2020 Behavioral Risk Factor Surveillance System (BRFSS) Asthma Call-Back Survey data (N=9,813).
  • Development and comparison of XGBoost, SVM, random forest, LASSO, and GBM models using accuracy, AUC, precision, and recall metrics.
  • Evaluation and improvement of model calibration using reliability plots, Platt scaling, and isotonic regression; predictor importance assessed via VIP and SHAP.

Main Results:

  • XGBoost demonstrated the highest performance (AUC: 0.95), followed closely by random forest and GBM.
  • Random forest achieved the highest sensitivity (0.9786), making it suitable for initial asthma screening.
  • Isotonic regression significantly improved model calibration, particularly for the random forest model (ECE reduced from 0.0158 to 0.0086).
  • Overnight hospitalization visits and time since last asthma medication were the most influential predictors.

Conclusions:

  • The developed analytical methodology effectively identifies behavioral risk factors for asthma.
  • Predictive models derived from multidimensional health surveys can aid in diagnosing chronic lung diseases.
  • These findings support early asthma diagnosis and proactive management by clinicians.
Abstract

Related Concept Videos