Related Experiment Video
Updated: Mar 6, 2026

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications
Published on: December 15, 2023
Continual few-shot named entity recognition against catastrophic forgetting and overfitting
Yuanyuan Zhao1, S L Zhao2, Minghu Wang2
1School of Mathematical Sciences, Hebei Normal University, Shijiazhuang, 050024, Hebei, China; Hebei Provincial Engineering Research Center for Supply Chain Big Data Analytics & Data Security, Shijiazhuang, 050024, Hebei, China; Hebei Provincial Key Laboratory of Network and Information Security, Shijiazhuang, 050024, Hebei, China; Department of Information Engineering, Shijiazhuang College of Applied Technology, Shijiazhuang, 050800, Hebei, China.
Abstract:
Named Entity Recognition (NER), a fundamental task in information extraction, identifies and classifies pre-defined entity types in text. In dynamic real-world scenarios, NER systems must continuously learn new entity types from only a few labeled examples, presenting challenges of catastrophic forgetting and few-shot overfitting. To address these issues, this paper proposes the Prompt-guided Memory-Knowledge augmentation with Contrastive and knowledge Distillation (PMKCD) framework. Our approach uses label prompting to explicitly model category semantics, enhancing discrimination in low-resource settings. It further introduces a novel data augmentation strategy that combines a dynamic memory set with knowledge-guided, dual-granularity replacement to generate high-quality synthetic samples. This facilitates balanced knowledge integration across old and new classes. The framework employs contrastive distillation to jointly optimize model stability and plasticity. Extensive experiments on three public benchmarks show that PMKCD consistently outperforms existing methods in continual few-shot NER. The results show an average relative improvement of 14.75% in Micro-F1 and 8.69% in Macro-F1 across all incremental stages, along with significant gains in recognition accuracy, forgetting mitigation, and generalization capability.
Related Concept Videos
Forgetting
Encoding...
Survival Tree
Building a Survival Tree
Constructing a...
Interference and Decay
Interference occurs when competing memories hinder the retrieval of particular information. It can be classified into two types: proactive and retroactive interference. Proactive...
Long-Term Memory
Long-term memory can be categorized into two primary types: explicit and implicit memory. Explicit memory, also known as declarative memory, involves the conscious recollection of information that we deliberately try to remember, recall, and articulate. This type of memory encompasses specific facts, events, and...
Observational Learning
Avoidance Learning and Learned Helplessness
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...