对不平衡的集群进行强有力的显著性测试
1Department of Statistics & O.R., UNC-Chapel Hill.
概括
统计集群验证对于识别真实数据结构至关重要. 一种新的方法改进了SigClust对不平衡的群体大小,提高了疾病亚型的发现.
科学领域:
- 数据科学
- 统计数据
- 生物信息学
背景情况:
- 聚类方法揭示了数据结构,特别是在高维度.
- 统计集群验证评估发现的集群的真实性.
- SigClust 方法是基准,但由于集群大小不平衡,其表现不佳.
研究的目的:
- 解决SigClust在不同大小的集群验证方面的局限性.
- 为平衡和不平衡数据提出一种新的,强大的集群验证方法.
- 在高维数据集中改进罕见亚型的检测.
主要方法:
- 开发了一种新的k-means集群的概括.
- 拟议的方法增强了统计集群验证.
- 这种方法在高维基基因表达数据上进行了测试.
主要成果:
- 这种新方法在集群验证中表现出更高的效率,特别是在集群大小不平衡的情况下.
- 解释了SigClust方法在不平衡环境中的低性能.
- 该方法在癌数据的真实应用中被证明有效.
结论:
- 开发的方法为统计集群验证提供了强大而多功能工具.
- 这一进步对于在复杂数据集中识别罕见的亚型特别有价值.
- 该研究提供了Python实现的实际应用.
相关概念视频
Significance Testing: Overview
3.8K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
3.8K
Sign Test for Matched Pairs
207
The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in...
To conduct the sign test, we first calculate the differences in...
207
Introduction to the Sign Test
990
The sign test is an important tool in nonparametric statistics, offering a straightforward yet effective method for analyzing matched pairs, nominal data, or hypotheses concerning the median of a population. It transforms data points into positive or negative signs, avoiding the need for assumptions about data distribution and instead focusing on the direction of change. It is particularly valuable when data does not conform to the normal distribution requirements of many parametric tests. For...
990
Bonferroni Test
2.8K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.8K
One-Way ANOVA: Unequal Sample Sizes
5.9K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
5.9K
Sign Test for Nominal Data
152
The sign test is a nonparametric method used to evaluate hypotheses about the median of a single sample or to compare the medians of two related samples. The sign test is particularly useful when dealing with nominal data, which includes distinct categories without an inherent order, such as names, labels, and preferences. Nominal data restricts statistical analysis to evaluating population proportions rather than mean or median values that require continuous data.
For example, consider a...
For example, consider a...
152


