Foundations of Machine Learning-Based Clinical Prediction Modeling: Part V-A Practical Approach to Regression
Victor E Staartjes1, Julius M Kernbach2
1Machine Intelligence in Clinical Neuroscience (MICN) Laboratory, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland. victoregon.staartjes@usz.ch.
This study details training a machine learning clinical prediction model for continuous outcomes using glioblastoma patient data. It provides code and methods for imputation, feature selection, and model validation, evaluating various regression techniques.
Area of Science:
- Medical Informatics
- Machine Learning in Healthcare
- Clinical Prediction Modeling
Background:
- Developing accurate clinical prediction models is crucial for patient outcomes.
- Machine learning offers powerful tools for analyzing complex medical data.
- Glioblastoma patient survival prediction remains a significant challenge.
Purpose of the Study:
- To provide a comprehensive guide for training and validating machine learning clinical prediction models for continuous outcomes.
- To demonstrate practical implementation of data pre-processing, feature selection, and model evaluation techniques.
- To offer reproducible code and a simulated dataset for hands-on learning.
Main Methods:
- Utilized a simulated dataset of 10,000 glioblastoma patients.
- Implemented k-nearest neighbor imputation for missing data.
- Employed recursive feature elimination and k-fold cross-validation for feature selection and model robustness.
- Demonstrated regression models including generalized linear models, generalized additive models, random forests, ridge, and LASSO regressors.
Main Results:
- Evaluated regression model performance using Root Mean Square Error (RMSE), Mean Average Error (MAE), and R-squared statistic.
- Assessed model performance across the outcome spectrum using quantile-quantile plots.
- Explained a nonparametric method for determining variable importance.
Conclusions:
- The study provides a practical framework for building and validating machine learning models for continuous clinical outcomes.
- The methods and code facilitate reproducible research in clinical prediction.
- Understanding variable importance is key for interpreting and trusting predictive models in healthcare.
Related Concept Videos
Steps in Outbreak Investigation
Regression Analysis
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
Multiple Regression
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
Mechanistic Models: Compartment Models in Individual and Population Analysis
Regression Toward the Mean
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...


