相关实验视频

Updated: Jan 15, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

关于对有限数据的大型语言模型对阿拉伯语进行微调的有效性

Mohamed Alkaoud¹

¹Department of Computer Science, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia.

|October 8, 2025

概括

在小型数据集上微调大型语言模型 (LLM) 显著改善了阿拉伯自然语言处理 (NLP) 任务,优于现有模型. 这种数据效率高的方法为模型适应提供了可预测的扩展.

科学领域:

自然语言处理自然语言处理.
人工智能的人工智能
机器学习机器学习

背景情况:

多语法LLM在阿拉伯语NLP的零射击和少射击学习方面表现有前途.
微调的BERT变体目前在许多阿拉伯语任务上实现了最先进的 (SOTA) 性能.
专业模型通常需要大量的注释训练数据.

研究的目的:

通过使用最少的数据,研究对阿拉伯语NLP任务微调通用LLM的有效性.
将微调的LLM与SOTA模型在情绪分析,刺言论检测和新闻分类方面的表现进行比较.
分析模型大小和数据高效微调方法的影响.

主要方法:

对阿拉伯语NLP任务培训数据的小子集 (3.0%-7.5%) 进行微调GPT-4o mini和Gemma-3-27B.
评估情绪分析 (ArSAS),刺言论检测 (ArSarcasm) 和新闻分类 (ASND) 的表现.
将GPT-4o和GPT-4o mini进行比较,以评估模型大小对微调效率和性能的影响.

主要成果:

在小型数据集上微调GPT-4o mini在情绪分析和刺言论检测方面超过了以前的SOTA结果.
在新闻分类方面,GPT-4o mini和Gemma-3-27B的性能与SOTA相似.
像GPT-4o这样的大型机型需要比较小的模型 (例如GPT-4o mini) 更少的标记示例,以获得可比性能.
观察到可预测的缩放规律,允许使用较小的模型对更大的模型进行准确的性能估计.

结论:

通过对数据进行高效的微调,LLM可以有效地适应阿拉伯NLP,在没有大型注释数据集的情况下,其性能优于已有的模型.
拟议的方法证明了在不同的LLM中普遍性,包括开源选项.
可预测的缩放规律促进了阿拉伯NLP的高效模型选择和适应策略.

更多相关视频

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

相关概念视频

Improving Translational Accuracy

Improving Translational Accuracy

Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...

Improving Translational Accuracy

Improving Translational Accuracy

Language Development

Language Development

Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...

Language and Cognition

Language and Cognition

Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.

Survival Tree

Survival Tree

Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...