相关实验视频
Updated: Jun 23, 2025

05:37
An R-Based Landscape Validation of a Competing Risk Model
Published on: September 16, 2022
2.0K
概括
交叉验证可以对机器学习模型的评估产生负面影响,这是由于分布式偏差. 一种新的再平衡交叉验证方法纠正了这种偏差,在数据稀缺的场景中改善了绩效评估.
科学领域:
- 机器学习 机器学习
- 统计建模 统计建模
- 数据科学数据科学数据科学
背景情况:
- 交叉验证是估计机器学习模型性能的标准.
- 交叉验证 (LOOCV) 在数据稀缺的环境中很常见,以最大限度地利用培训数据.
- LOOCV在除了一个实例以外的所有实例上训练一个模型,在持有实例上进行测试.
研究的目的:
- 在LOOCV.中识别和描述绩效评估偏差.
- 提出一种新的交叉验证技术来缓解这种偏差.
- 在各种场景中证明拟议方法的有效性.
主要方法:
- 在LOOCV.中研究了培训折叠平均和测试实例标签之间的关系.
- 引入了重新平衡的交叉验证方法来纠正分布偏差.
- 使用合成数据,机器学习基准和现实世界数据集评估了拟议的方法.
主要成果:
- 证明LOOCV在培训和测试标签之间引入了负相关性 (分布偏差).
- 显示这种偏差会对性能估计和超参数调整产生负面影响,有利于较弱的规范化.
- 拟议的再平衡交叉验证显著提高了评估准确性.
结论:
- 分布偏差是标准的leave-one-out和leave-P-out交叉验证中固有的问题.
- 拟议的再平衡交叉验证有效地纠正了这种偏差.
- 这种新方法提供了更可靠的性能估计和超参数优化,特别是在数据有限的情况下.
相关概念视频
Survival Tree
79
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
79
Bias
4.2K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
4.2K
Quantifying and Rejecting Outliers: The Grubbs Test
1.5K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.5K
One-Way ANOVA: Unequal Sample Sizes
5.7K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
5.7K
Outliers and Influential Points
4.0K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.0K
One-Way ANOVA: Equal Sample Sizes
3.3K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.3K

