双级变量选择方法的解释性
Gregor Buch1,2,3, Andreas Schulz1, Irene Schmidtmann2
1Preventive Cardiology and Preventive Medicine, Department of Cardiology, University Medical Center of the Johannes Gutenberg University Mainz, Mainz, Germany.
Biometrical journal. Biometrische Zeitschrift
|March 23, 2024
概括
双级变量选择方法优于标准LASSO,提高了模型的解释性,特别是在处理相关预测器时. 组指数 LASSO (GEL) 提供了一个平衡的方法来选择分组变量.
科学领域:
- 统计 统计 统计 统计
- 机器学习 机器学习
- 生物信息学是一种生物信息学.
背景情况:
- 变量选择通过创建较少的模型来增强模型的解释性.
- 标准的以稀疏度为重点的方法可能会失败,当预测因素是相关的或上下文相关.
- 双级选择可以在特征组内识别预测成员.
研究的目的:
- 调查双级变量选择技术是否与标准LASSO相比提高了模型的解释性.
- 评估对LASSO的组指数LASSO (GEL),稀疏组LASSO (SGL) 和复合最小形惩罚 (cMCP) 的性能.
- 在不同的分组策略下评估选择相关性,组一致性和对线性容忍度.
主要方法:
- 应用了GEL,SGL,cMCP和LASSO在时间到事件,回归和分类任务中进行预测器选择.
- 使用来自1001名患者队列的引导样本.
- 使用基于先前知识,相关性和随机分配的分组进行比较的方法.
主要成果:
- 双级选择方法在所有评估标准中始终优于LASSO.
- cMCP显示出优越的选择相关性.
- SGL 显示了强大的群体一致性.
- 盖尔展现了全方位的能力,选择了高度相关的相关和相关的预测因素.
结论:
- 对于具有分组或相关变量的可解释模型,双级选择方法比 LASSO 更有效.
- 特别推GEL是因为它能够联合选择相关预测因素,同时保持高可解释性.
- 选择分组策略会影响双层选择方法的性能.
相关概念视频
Biostatistics: Overview
239
Biostatistics plays a crucial role in understanding and analyzing data in healthcare and biology. Biostatisticians conduct experiments, gather evidence, and draw meaningful conclusions using statistical methods and techniques. Different variables form the foundation of biostatistical analysis, allowing researchers to understand and interpret data effectively. These variables are classified into different types, each serving a specific purpose in statistical analysis.
Discrete variables are...
Discrete variables are...
239
Variability: Analysis
142
Measures of variability are statistical metrics that reveal the dispersion pattern within a dataset. They are pivotal in biostatistics, providing insights into the heterogeneity within health and biological data. Variability signifies the degree to which data points diverge from one another, helping researchers understand the potential range of values and associated uncertainty within the data.
The range is a simple measure of variability, indicating the difference between the highest and...
The range is a simple measure of variability, indicating the difference between the highest and...
142
Multi-input and Multi-variable systems
106
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
106
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
53
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
53
Survival Tree
84
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
84
Multiple Regression
3.0K
Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
3.0K


