解释变量分布对不纯度指标的行为的影响 在分类树学习中使用的不纯度指标
Krzysztof Gajowniczek1, Marcin Dudziński1
1Institute of Information Technology, Warsaw University of Life Sciences-SGGW, 02-787 Warszawa, Poland.
Entropy (Basel, Switzerland)
|January 8, 2025
概括
这项研究分析了解释变量如何影响诸如决策树学习中的香农和萨利斯的杂质指标. 研究结果揭示了变性自然如何影响交互式树木结构,帮助专家决策.
科学领域:
- 机器学习 机器学习
- 信息理论 信息理论
- 统计 统计 统计 统计
背景情况:
- 决策树算法依赖于分割节点的杂质测量.
- 现有的杂质测量可能对解释变量的性质有不同的敏感性.
- 交互式学习需要强大的杂质措施来有效地打破平局.
研究的目的:
- 分析解释变量分布对杂质量测量的影响.
- 为了评估Shannon,Renyi,Tsallis,Sharma-Mittal,Sharma-Taneja和Kapur的行为.
- 了解这些措施在交互式决策树学习中的影响,特别是在决胜场景中.
主要方法:
- 从正常,考奇,均,指数和β分布中模拟解释变量.
- 使用逻辑回归模型生成二进制响应.
- 对参数进行灵敏度分析并可视化结果.
主要成果:
- 基于解释性变量分布的不同杂质量测量的不同表现.
- 描述了特定解释变量的对交互式树学习过程的影响.
- 提供了可变分布和杂质测量行为的图形表示.
结论:
- 解释变量分布的选择显著影响了杂质测量值和行为.
- 了解这种影响对于优化交互式决策树学习和专家决策支持至关重要.
- 灵敏度分析强调了参数调整对于杂质测量的重要性.
相关概念视频
Survival Tree
57
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
57
Outliers and Influential Points
4.0K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.0K
Distributions to Estimate Population Parameter
4.0K
The accurate values of population parameters such as population proportion, population mean, and population standard deviation (or variance) are usually unknown. These are fixed values that can only be estimated from the data collected from the samples. The estimates of each of these parameters are sample proportion, the sample mean, and sample standard deviation (or variance). To obtain the values of these sample statistics, data are required that have particular distribution and central...
4.0K
Quantifying and Rejecting Outliers: The Grubbs Test
1.5K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.5K
Probability Distributions
6.8K
The probability of a random variable x is the likelihood of its occurrence. A probability distribution represents the probabilities of a random variable using a formula, graph, or table. There are two types of probability distribution– discrete probability distribution and continuous probability distribution.
A discrete probability distribution is a probability distribution of discrete random variables. It can be categorized into binomial probability distribution and Poisson...
A discrete probability distribution is a probability distribution of discrete random variables. It can be categorized into binomial probability distribution and Poisson...
6.8K
Choosing Between z and t Distribution
2.7K
The z and the Student t distribution estimate the population mean using the sample mean and standard deviation. However, to decide which distribution to use for a calculation, one needs to determine the sample size, the nature of the distribution, and whether the population standard deviation is known. If the population standard deviation is known and the population is normally distributed, or if the sample size is greater than 30, the z distribution is preferred. The Student t distribution is...
2.7K


