对文本分类的自适应提升LLM
IEEE transactions on neural networks and learning systems
|January 12, 2026
概括
研究人员开发了一种循环生成预训练变压器 (RGPT),以增强大型语言模型 (LLM) 对于文本分类任务的能力. 这种新的方法显著优于现有模型,提高了文本分类的准确性.
科学领域:
- 自然语言处理自然语言处理.
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 大规模语言模型 (LLM) 在各种NLP任务中展示了先进的能力.
- 越来越多的LLM的能力在文本分类研究的未来造成了不确定性.
- 专门用于文本分类的LLM的有效性仍然是一个悬而未决的问题.
研究的目的:
- 通过LLMs. 调查文本分类的进展程度.
- 引入一种新的框架,即循环生成预训练变压器 (RGPT),用于专门的文本分类LLMs.
主要方法:
- RGPT是一个适应性增强框架,它创建了一个基础学习者的序列.
- 它动态调节培训数据分布,并代微调LLMs.
- 基础学习者逐渐使用历史预测轨迹进行专业化.
主要成果:
- 与八个最先进的预训练语言模型相比,RGPT表现优越.
- 它在四个基准数据集中表现优于七个尖端的LLM.
- 实现了2.90%的平均绩效增长.
结论:
- 对于文本分类的专业LLM来说,RGPT是一个显著的进步.
- 拟议的框架有效地利用了LLM的潜力,提高了文本分类准确度.
- RGPT为专业语言建模的未来研究提供了一个有希望的方向.
相关概念视频
Improving Translational Accuracy
14.1K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
14.1K
Improving Translational Accuracy
3.5K
3.5K
Aggregates Classification
963
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
963
Language Development
831
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
831
Survival Tree
382
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
382
Force Classification
2.3K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
2.3K
