在GNN学习评估中的不确定性:在GNN社区检测中量化随机性的措施之间的比较
William Leeney1, Ryan McConville1
1School of Engineering Mathematics and Technology, University of Bristol, Bristol BS8 1TR, UK.
Entropy (Basel, Switzerland)
|January 22, 2024
概括
图形神经网络 (GNN) 在无监督社区检测方面表现出色. 严格的超参数优化对于准确的性能评估至关重要,瓦瑟斯坦距离提供了最可靠的随机性评估.
科学领域:
- 图形神经网络 (GNN) 是一个神经网络.
- 机器学习 机器学习
- 网络分析 网络分析
背景情况:
- 使用GNN的无监督社区检测利用了图形连接和特征信息.
- 对社区检测的GNN性能进行准确的评估,由于许多影响因素而复杂化.
- 识别潜伏社区在社交网络,基因组学及其他领域都有广泛的应用.
研究的目的:
- 评估超参数优化对无监督社区检测中的GNN性能的影响.
- 在不同的评估指标中比较算法排名的一致性和质量.
- 确定用于评估GNN绩效评估中的随机性最可靠的指标.
主要方法:
- 使用超参数优化与默认超参数的GNN性能比较.
- 评估三种不同的指标来评估随机性下算法排名的一致性.
- 评估Wasserstein距离 (W随机系数) 用于量化随机性.
主要成果:
- 忽视超参数优化导致GNN性能大幅下降.
- 算法排名中的关系可以大大影响随机性的量化.
- 与其他指标相比,瓦瑟斯坦距离为随机性提供了最可靠的评估.
结论:
- 标准化的评估标准对于可重复的GNN绩效报告至关重要.
- 超参数调整对于在社区检测任务中实现最佳GNN性能至关重要.
- 随机性系数W提供了一种可靠的方法来评估基于GNN的社区检测算法的稳定性.
更多相关视频
09:49Divergence of Root Microbiota in Different Habitats based on Weighted Correlation Networks
Published on: September 25, 2021
4.3K
12:27Large-scale Reconstructions and Independent, Unbiased Clustering Based on Morphological Metrics to Classify Neurons in Selective Populations
Published on: February 15, 2017
7.0K
相关概念视频
Wald-Wolfowitz Runs Test II
244
The Wald-Wolfowitz runs test, commonly referred to as the runs test, is a nonparametric test used to assess the randomness of ordered data. The test evaluates the number of runs, which are consecutive sequences of similar elements within the data. If the number of runs is significantly higher or lower than expected, the data is considered non-random, indicating a detectable pattern or structure.
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and...
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and...
244
Quantifying and Rejecting Outliers: The Grubbs Test
1.6K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.6K
Wald-Wolfowitz Runs Test I
650
The Wald-Wolfowitz test, also known as the runs test, is a nonparametric statistical test used to assess the randomness of a sequence of two different types of elements (e.g., positive/negative values, successes/failures). It examines whether the order of the elements in a sequence is random or if there is a pattern or trend present. This nonparametric test applies to any ordered data despite the population and sample data distribution, even if a higher sample size is available.
The test works...
The test works...
650
Random Sampling Method
11.1K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest. Among the various sampling methods used by...
11.1K
Randomized Experiments
7.0K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
7.0K
Comparing the Survival Analysis of Two or More Groups
195
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
195
