Related Experiment Videos
A Physics-Informed Benchmarking Framework for Machine Learning and Tree-Based Ensembles in IIoT-Enabled Predictive
1Department of Financial Management, National Defense University, Taipei 112305, Taiwan.
Abstract:
Reliable Predictive Maintenance (PdM) in Industrial Internet of Things (IIoT) environments is challenged by severe class imbalance, heterogeneous sensor variables, inconsistent experimental protocols, and deployment constraints. This study proposes a Physics-Informed Benchmarking Framework that integrates engineering-guided feature construction, Mutual Information (MI)-based feature relevance analysis, standardized model development, and deployment-oriented evaluation within a unified and reproducible workflow. Using the AI4I 2020 Predictive Maintenance Dataset, Logistic Regression, Isolation Forest, Random Forest, and Extreme Gradient Boosting (XGBoost) were evaluated using identical feature representations, train-test partitions, preprocessing procedures, and imbalance-handling strategies. The engineered feature space incorporates thermal, mechanical, interaction, and degradation-related information derived from the original sensor measurements. The results show that tree-based ensembles provide the strongest overall performance under severe class imbalance. Random Forest achieved an accuracy of 0.986, an F1-score of 0.722, and a ROC-AUC of 0.983, providing the best balance between failure detection and false-alarm control. XGBoost achieved an accuracy of 0.978, a recall of 0.853, and the lowest inference latency of 0.35 ms, indicating its suitability for latency-sensitive IIoT deployment. These findings demonstrate that combining engineering-guided feature representation with a standardized evaluation protocol enables fair comparison of representative learning paradigms while preserving engineering interpretability and deployment relevance.