Related Experiment Videos
TriP: A triple-prompt framework aligning pre-training and class-incremental objectives in continual graph learning
Can-Ming Cui1, Hui-Yu Zhou2, Pei-Yuan Lai3
1School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, 510006, China.
Abstract:
The proliferation of dynamic graph-structured data necessitates Continual Graph Learning (CGL) to enable models to learn incrementally and retain past knowledge. Class-incremental learning (class-IL) in CGL is particularly challenging due to catastrophic forgetting. Existing CGL strategies, including recent prompt-based learning methods, often grapple with significant memory overhead and suboptimal alignment between pre-training objectives and downstream continual tasks. We propose TriP, a triple-prompt framework aligning pre-training and class-incremental objectives in continual graph learning. As a lightweight parameter isolation-based method, TriP utilizes feature-level and class-level prompts to precisely capture task-specific knowledge. It introduces a unified prompt template that aligns downstream classification with self-supervised pre-training objectives, which can bridge the semantic gap and maximize the generalization capabilities of pre-trained graph models. Extensive experiments on four public benchmark datasets demonstrate that our method significantly outperforms state-of-the-art approaches, illustrating its effectiveness in mitigating catastrophic forgetting and improving the efficiency of continual learning on graphs.
Related Concept Videos
Observational Learning
Introduction to Learning
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
Associative Learning
Classical conditioning, also known...
Cognitive Learning
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
Purposive Learning
Multi-input and Multi-variable systems
In the absence of...