探索整个Rashomon集的稀疏决策树
Rui Xin1, Chudi Zhong1, Zhi Chen1
1Duke University.
Advances in neural information processing systems
|October 3, 2023
概括
研究人员开发了一种方法来找到所有同样好的机器学习模型,称为Rashomon集,用于稀疏的决策树. 这为超出单个算法输出的模型选择提供了更多的控制.
科学领域:
- 机器学习 机器学习
- 人工智能的人工智能
- 数据科学数据科学数据科学
背景情况:
- 机器学习算法通常选择一个模型,限制对同样高性能替代品的探索.
- 拉什蒙集包括所有解释数据几乎同样好的模型.
- 探索替代模型对于发现标准损失函数无法捕获的可取性质至关重要.
研究的目的:
- 介绍第一个完全列举Rashomon集的技术,用于稀疏的决策树.
- 为了使从业人员能够探索和从一套全面的几乎最佳模型中进行选择.
- 为理解机器学习中的模型可变性和选择提供一个框架.
主要方法:
- 开发了一种新的技术,用于对稀疏决策树的Rashomon集进行完整的计数.
- 引入了一种专门的数据结构,用于有效查询和采样Rashomon集.
- 应用了Rashomon集计数来分析变量重要性,并为不同指标和数据子集推导相关的Rashomon集.
主要成果:
- 成功列举了Rashomon集的稀疏决策树,这是第一次高度非线性离散函数类.
- 证明了Rashomon准确性集可以用于列举Rashomon集的平衡准确性和F1得分.
- 展示了使用完整数据集的Rashomon集从数据子集生成Rashomon集的能力.
结论:
- 开发的技术提供了前所未有的对模型选择的控制,通过提供所有大约同样好的模型.
- 拉什蒙集有助于更深入地了解不同数据子集中的模型行为,变量重要性和稳定性.
- 这项工作使用户能够战略性地选择模型,超越标准算法单模型输出的局限性.
更多相关视频
相关概念视频
Survival Tree
105
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
105
Decision Making: Traditional Method
4.0K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.0K
Contingency Table
2.5K
A contingency table provides a way of portraying data that can facilitate calculating probabilities. It is a method of displaying a frequency distribution as a table with rows and columns to show how two variables may be dependent (contingent) upon each other; The table helps determine conditional probabilities quite quickly and can help systematically organize, analyze and quantify data. The table displays sample values concerning two variables that may be dependent or contingent on one...
2.5K
Randomized Experiments
7.0K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
7.0K
Decision Making: P-value Method
5.5K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.5K
Decision Making
133
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
133


