对进化K-媒介集群性能进行基准测试的有效性指数
Abiodun M Ikotun1, Faustin Habyarimana1, Absalom E Ezugwu2
1School of Mathematics, Statistics and Computer Science, University of KwaZulu- Natal, KwaZulu-Natal, Pietermaritzburg Campus, Durban, South Africa.
Scientific reports
|July 2, 2025
概括
这项研究评估了进化K-Means聚类的内部有效性指数. 卡林斯基-哈拉巴斯 (CH) 和Silhouette指数在自动集群任务中被证明是最有效的.
科学领域:
- 数据科学数据科学数据科学
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- K-Means 集群需要预先定义的集群数量,限制其在自动数据分析中的使用.
- 进化K-Means (E-KM) 算法集成metaheuristics来克服K-Means的局限性,使用内部有效性指数来自动确定集群.
- 内部有效性指数的表现依赖于数据,影响了E-KM结果的可靠性.
研究的目的:
- 在增强火算法-K-Means (FA-K-Means) 框架内评估15个内部有效性指数的性能.
- 通过使用进化方法来确定自动集群任务的最有效的内部有效性指数.
- 为E-KM算法选择适应性函数提供实际指导.
主要方法:
- 这项研究使用了增强的火算法-K-Means (FA-K-Means) 框架,将火元启证与K-Means结合起来.
- 在FA-K-Means框架内,十五个不同的内部有效性指数被评估为适应性函数.
- 在各种具有不同结构性质的现实和合成数据集中评估了性能.
主要成果:
- 卡林斯基-哈拉巴斯指数 (CH) 在各种数据集中表现一致强.
- 轮指数在确定最佳集群配置方面也显示出强大而可靠的表现.
- 其他评估的指数表现出可变的有效性,通常取决于特定的数据集特征.
结论:
- 建议使用Calinski-Harabasz (CH) 和Silhouette指数作为进化K-Means算法的健身函数.
- 这些指数为自动集群任务提供更可靠和更一致的集群性能.
- 这些发现为研究人员和从业人员在E-KM应用中选择有效性指数提供了实际见解.
相关概念视频
Kendall's Coefficient of Concordance
542
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects...
542
Expected Frequencies in Goodness-of-Fit Tests
2.6K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
2.6K
Goodness-of-Fit Test
4.1K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
4.1K
Quantifying and Rejecting Outliers: The Grubbs Test
2.1K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
2.1K
Spearman's Rank Correlation Test
1.0K
Spearman's rank correlation test, also known as Spearman's rho, is a nonparametric method for assessing the strength and direction of association between two variables. This test is particularly valuable when the data distribution is unknown or when the assumption of normality does not hold. Named after the English psychologist and statistician Dr. Charles Edward Spearman, it serves as the nonparametric counterpart to Pearson's correlation coefficient.
Spearman's test calculates...
Spearman's test calculates...
1.0K
Kendall's Tau Test
836
Kendall's tau test, also known as the Kendall rank coefficient test, is a nonparametric method for assessing association between two variables. This test is particularly useful for identifying significant correlations when the distributions of the sample and population are unknown. Developed in 1938 by the British statistician Sir Maurice George Kendall, the tau coefficient (denoted as τ) serves as a rank correlation coefficient, with values ranging from -1 to +1.
A τ value...
A τ value...
836


