Related Experiment Video
Updated: May 6, 2026

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
Published on: October 11, 2018
Prediction and feature selection of low birth weight using machine learning algorithms
Tasneem Binte Reza1, Nahid Salma2
1Department of Statistics and Data Science, Jahangirnagar University, Savar, Dhaka, 1342, Bangladesh.
Insights
The wrapper method and Random Forest (RF) machine learning model effectively predict low birth weight (LBW). Identifying key risk factors like maternal age and twin birth can help reduce LBW prevalence.
Area of Science:
- Public Health
- Biostatistics
- Machine Learning
Background:
- Low birth weight (LBW), defined as <2,500g, poses significant global health risks, including increased neonatal mortality.
- Identifying LBW predictors is crucial for developing effective interventions and improving infant health outcomes.
Purpose of the Study:
- To identify significant risk factors for LBW using machine learning (ML) approaches.
- To determine the optimal feature selection technique and the best predictive ML model for LBW.
Main Methods:
- Utilized the Boruta algorithm and wrapper method for feature selection.
- Employed Logistic Regression (LR) and ML classifiers (DT, SVM, NB, RF, XGBoost, AdaBoost) for LBW prediction.
- Evaluated model performance using specificity, sensitivity, accuracy, F1 score, and AUC.
Main Results:
- The wrapper method identified key features such as maternal age, education, wealth index, and twin birth.
- Random Forest (RF) demonstrated superior performance in predicting LBW, achieving an accuracy of 85.86% and an F1 score of 0.9243.
- The wrapper method significantly improved the performance of both LR and ML models, with specific models identifying crucial factors like twin birth and cesarean delivery.
Conclusions:
- The wrapper method is the optimal feature selection technique for LBW prediction.
- Machine learning models, particularly Random Forest, outperform traditional methods in predicting LBW.
- Identified risk factors can inform Bangladeshi policymakers to mitigate LBW prevalence.
Background And Aims:
The birth weight of a newborn is a crucial factor that affects their overall health and future well-being. Low birth weight (LBW) is a widespread global issue, which the World Health Organization defines as weighing less than 2,500 g. LBW can have severe negative consequences on an individual's health, including neonatal mortality and various health concerns throughout their life. To address this problem, this study has been conducted using BDHS 2017-2018 data to uncover important aspects of LBW using a variety of machine learning (ML) approaches and to determine the best feature selection technique and best predictive ML model.
Methods:
To pick out the key features, the Boruta algorithm and wrapper method were used. Logistic Regression (LR) used as traditional method and several machine learning classifiers were then used, including, DT (Decision Tree), SVM (Support Vector Machine), NB (Naïve Bayes), RF (Random Forest), XGBoost (eXtreme Gradient Boosting), and AdaBoost (Adaptive Boosting), to determine the best model for predicting LBW. The model's performance was evaluated based on the specificity, sensitivity, accuracy, F1 score and AUC value.
Results:
Result shows, Boruta algorithm identifies eleven significant features including respondent's age, highest education level, educational attainment, wealth index, age at first birth, weight, height, BMI, age at first sexual intercourse, birth order number, and whether the child is a twin. Incorporating Boruta algorithm's significant features, the performance of traditional LR and ML methods including DT, SVM, NB, RF, XGBoost, and AB were evaluated where LR, had a specificity, sensitivity, accuracy and F1 score of 0.85, 0.5, 85.15% and 0.915. While the ML methods DT, SVM, NB, RF, XGBoost, and AB model's respective accuracy values were 85.35%, 85.15%, 84.54%, 81.18%, and 84.41%. Based on the specificity, sensitivity, accuracy, F1 score and AUC, RF (specificity = 0.99, sensitivity = 0.58, accuracy = 85.86%, F1 score = 0.9243, AUC = 0.549) outperformed the other methods. Both the classical (LR) and machine learning (ML) models' performance has improved dramatically when important characteristics are extracted using the wrapper method. The LR method identified five significant features with a specificity, sensitivity, accuracy and F1 score of 0.87, 0.33, 87.12% and 0.9309. The region, whether the infant is a twin, and cesarean delivery were the three key features discovered by the DT and RF models, which were implemented using the wrapper technique. All three models had the identical F1 score of 0.9318. However, "child is twin" was recognized as a significant feature by the SVM, NB, and AB models, with an F1 score of 0.9315. Ultimately, with an F1 score of 0.9315, the XGBoost model recognized "child is twin" and "age at first sex" as relevant features. Random Forest again beat the other approaches in this instance.
Conclusions:
The study reveals Wrapper method as the optimal feature selection technique. The ML method outperforms traditional methods, with Random Forest (RF) being the most effective predictive model for Low-Birth-Weight prediction. The study suggests that policymakers in Bangladesh can mitigate low birth weight newborns by considering identified risk factors.

