超越XGBoost和SHAP:揭示真正的功能重要性
1Faculty of Data Science, Musashino University, 3-3-3 Ariake Koto-ku, Tokyo 135-8181, Japan.
Journal of hazardous materials
|January 29, 2025
概括
这项研究突出了机器学习模型中的潜在偏差,例如XGBoost和SHAP值. 研究人员必须使用严格的方法来确保可靠的特征重要性和准确的模型评估.
科学领域:
- 机器学习 机器学习
- 数据科学数据科学数据科学
- 统计建模 统计建模
背景情况:
- XGBoost和SHAP值是用于机器学习分析的强大工具.
- 然而,它们可能引入分析陷,例如夸大的特征重要性和解释偏见.
- 缺乏基本真相使严格的模型评估变得复杂.
研究的目的:
- 为研究人员概述关键的机器学习原则.
- 识别和解决XGBoost和SHAP价值解释中的潜在偏差.
- 在机器学习研究中倡导严格的统计方法.
主要方法:
- 专注于XGBoost的增量决策树构建过程.
- 分析SHAP值对模型结构和特征相互作用的依赖.
- 讨论模型评估中的基本真实值的作用和局限性.
主要成果:
- 由于专注于错误分类的例子,XGBoost可能会膨胀特征的重要性.
- SHAP值可能会受到模型结构和特征交互的影响.
- 基本真实值对于准确性至关重要,但不能保证真正的特征-目标关联.
结论:
- 研究人员必须意识到来自XGBoost和SHAP等方法的特征重要性偏差.
- 严格的统计方法是必要的可靠的模型评估和解释.
- 了解这些局限性增强了机器学习研究结果的可信性.
更多相关视频
03:37Author Spotlight: Impact of Intergenic Interactions on Disease-Identifying Dark Biomarkers
Published on: March 1, 2024
628
04:54Author Spotlight: IntelliSleepScorer — A High-Accuracy, Accessible GUI Software for Automated Sleep Stage Scoring in Mice and its Application in Psychiatric Research
Published on: November 8, 2024
428
相关概念视频
Outliers and Influential Points
4.0K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.0K
Quantifying and Rejecting Outliers: The Grubbs Test
1.5K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.5K
Aggregates Classification
299
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
299
Goodness-of-Fit Test
3.3K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
3.3K
Significance Testing: Overview
3.3K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
3.3K
Survival Tree
55
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
55
