森林随机变量选择方法的比较,用于连续结果的回归建模
Nathaniel S O'Connell1, Byron C Jaeger1, Garrett S Bullock1,2
1Department of Biostatistics and Data Science, Wake Forest University School of Medicine, Medical Center Boulevard, Winston-Salem, NC 27157, United States.
Briefings in bioinformatics
|March 10, 2025
概括
本研究对13种随机森林 (RF) 变量选择方法进行了基准测试,以获得连续结果. 推Boruta和aorsf R包用于基于轴的射频模型,而aorsf是最适合斜射频模型的.
科学领域:
- 机器学习 机器学习
- 统计建模 统计建模
- 数据科学数据科学数据科学
背景情况:
- 随机森林 (RF) 回归是一种广泛使用的机器学习技术,用于开发具有连续结果的预测模型.
- 变量选择或特征选择对于提高模型准确性,计算效率和数据收集实用性至关重要.
- 有限的证据存在,以指导在各种数据集中选择最佳的射频变量选择方法.
研究的目的:
- 为了对连续结果的13种随机森林变量选择方法的性能进行基准和比较.
- 为不同的数据集类型提供基于证据的指导,以选择可选变量选择方法.
- 用开放科学方法评估变量选择方法.
主要方法:
- 一项基准研究评估了13种RF变量选择方法,使用了59个公开可用的数据集.
- 性能是通过使用选定变量构建的射频模型的样本外R2来测量.
- 通过计算时间来评估效率,通过减少变量的百分比来评估简单性.
主要成果:
- 波鲁塔和aorsf R包中的变量选择方法在基于轴的射频模型中表现最好.
- 在aorsf R套件中的方法表明,斜射频模型的性能优于斜射频模型.
- 该研究确定了适合不同RF模型类型的特定RF变量选择方法.
结论:
- 博鲁塔和aorsf R包为基于轴的RF回归提供了有效的变量选择.
- 建议使用aorsf R包在斜射频回归模型中进行变量选择.
- 这项研究为通过知情的变量选择优化射频回归模型提供了有价值的见解.
相关概念视频
Multiple Regression
2.9K
Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
2.9K
Survival Tree
49
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
49
Regression Analysis
5.5K
Regression analysis is a statistical tool that describes a mathematical relationship between a dependent variable and one or more independent variables.
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
5.5K
Comparing the Survival Analysis of Two or More Groups
115
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
115
Randomized Experiments
6.7K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
6.7K
Pharmacokinetic Models: Comparison and Selection Criterion
35
Physiological and compartmental models are valuable tools used in studying biological systems. These models rely on differential equations to maintain mass balance within the system, ensuring an accurate representation of the dynamic processes at play.
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.
35


