Related Experiment Videos
Dual-channel hard negative sample generation for graph contrastive learning
Jianghui Cai1, Mengyu Li2, Haifeng Yang3
1School of Computer Science and Technology, Taiyuan University of Science and Technology, Taiyuan, 030024, PR China; School of Computer Science and Technology, North University of China, Taiyuan, 030051, PR China.
Abstract:
Graph Contrastive Learning (GCL) has demonstrated remarkable effectiveness in representation learning for graph-structured data. However, most existing GCL methods have two issues regarding the low-quality of negative samples. Firstly, most simple negative samples are semantically invalid and fail to provide discriminative signals. Secondly, false negative samples, which are caused by indiscriminate processing methods, may degrade the overall performance of the model. To this end, we propose a novel method called Dual-Channel Hard Negative Sample Generation for Graph Contrastive Learning (DCGCL). In it, we employ a dual-channel graph generator to apply controlled perturbations to the original adjacency and feature matrices. This process ensures high structural and feature similarity to the original graphs. To differentiate the semantics of the perturbed and original graphs, we introduce a maximizes distribution differences mechanism. This mechanism maximizes the distributional divergence between the two graph types while constraining the consistency of node probability distributions. Moreover, adopts a two-stage training strategy to dynamically inject hard negative samples in the later training phase for learning more generalized feature representations across samples of varying difficulty. Experimental results on diverse downstream tasks validate that DCGCL significantly enhances the performance of GCL models, outperforming state-of-the-art baselines with notable improvements.
Related Concept Videos
Difference from Background: Limit of Detection
The LOD indicates the presence or absence...
Downsampling
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
Significance of the Gradient Vector
Reducing Line Loss
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss in...
Gradient Vectors and Their Applications
Lossy Lines and Overvoltages
Attenuation
When constant series resistance and shunt conductance are present, voltage and current equations are modified. The propagation constant indicates that voltage and current waves consist of both forward and backward traveling components. These waves attenuate as they propagate, with the attenuation factor related to the resistance and conductance. In a...