Comparison and development of machine learning tools for the prediction of chronic obstructive pulmonary disease in
Xia Ma1,2, Yanping Wu3, Ling Zhang4
1Department of Pulmonary and Critical Care Medicine, General Hospital of Datong Coal Mine Group Co., Ltd., Datong, 037000, China.
Background:
Chronic obstructive pulmonary disease (COPD) is a major public health problem and cause of mortality worldwide. However, COPD in the early stage is usually not recognized and diagnosed. It is necessary to establish a risk model to predict COPD development.
Methods:
A total of 441 COPD patients and 192 control subjects were recruited, and 101 single-nucleotide polymorphisms (SNPs) were determined using the MassArray assay. With 5 clinical features as well as SNPs, 6 predictive models were established and evaluated in the training set and test set by the confusion matrix AU-ROC, AU-PRC, sensitivity (recall), specificity, accuracy, F1 score, MCC, PPV (precision) and NPV. The selected features were ranked.
Results:
Nine SNPs were significantly associated with COPD. Among them, 6 SNPs (rs1007052, OR = 1.671, P = 0.010; rs2910164, OR = 1.416, P < 0.037; rs473892, OR = 1.473, P < 0.044; rs161976, OR = 1.594, P < 0.044; rs159497, OR = 1.445, P < 0.045; and rs9296092, OR = 1.832, P < 0.045) were risk factors for COPD, while 3 SNPs (rs8192288, OR = 0.593, P < 0.015; rs20541, OR = 0.669, P < 0.018; and rs12922394, OR = 0.651, P < 0.022) were protective factors for COPD development. In the training set, KNN, LR, SVM, DT and XGboost obtained AU-ROC values above 0.82 and AU-PRC values above 0.92. Among these models, XGboost obtained the highest AU-ROC (0.94), AU-PRC (0.97), accuracy (0.91), precision (0.95), F1 score (0.94), MCC (0.77) and specificity (0.85), while MLP obtained the highest sensitivity (recall) (0.99) and NPV (0.87). In the validation set, KNN, LR and XGboost obtained AU-ROC and AU-PRC values above 0.80 and 0.85, respectively. KNN had the highest precision (0.82), both KNN and LR obtained the same highest accuracy (0.81), and KNN and LR had the same highest F1 score (0.86). Both DT and MLP obtained sensitivity (recall) and NPV values above 0.94 and 0.84, respectively. In the feature importance analyses, we identified that AQCI, age, and BMI had the greatest impact on the predictive abilities of the models, while SNPs, sex and smoking were less important.
Conclusions:
The KNN, LR and XGboost models showed excellent overall predictive power, and the use of machine learning tools combining both clinical and SNP features was suitable for predicting the risk of COPD development.
Related Concept Videos
01:27Chronic Obstructive Pulmonary Disease-IV: Assessement and Diagnostic Studies
Medical History
01:22Chronic Obstructive Pulmonary Disease
Smoking is a primary risk factor for COPD, with over 80% of patients having a history of it. Patients typically experience progressive dyspnea or labored breathing, frequent coughing, and recurrent pulmonary infections. Many eventually succumb to respiratory failure, characterized by...
01:20Chronic Obstructive Pulmonary Disease-I: Introduction
01:20Chronic Obstructive Pulmonary Disease-II: Pathophysiology
Chronic Inflammation
01:29Chronic Obstructive Pulmonary Disease-V: Management
Smoking Cessation
01:20COPD: Pathogenesis and Clinical Features
The primary cause for the onset of COPD is cigarette smoking and exposure to air pollution. These hazardous factors initiate a chain reaction within the lungs, resulting in chronic inflammation, damage to the airways, and a...