针对意大利语的高级基于自然的交互:LLaMAntino-3-ANITA
Marco Polignano1, Pierpaolo Basile2, Giovanni Semeraro2
1Department Computer Science, University of Bari Aldo Moro, Via E. Orabona 4, 70125, Bari, Apulia, Italy. marco.polignano@uniba.it.
Scientific reports
|February 3, 2026
概括
本研究介绍了LLaMAntino-3-ANITA-8B-Inst-DPO-ITA,意大利大语言模型 (LLM),为卓越的性能进行了微调. 它在意大利基准测试中取得了最先进的结果,在语言理解和问答任务中表现出有效性.
科学领域:
- 自然语言处理自然语言处理.
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 大型语言模型 (LLM) 需要针对特定语言进行调整.
- 梅塔-AI的LLaMA-3模型为LLM开发提供了坚实的基础.
- 指令调整和偏好优化是提高LLM能力的关键.
研究的目的:
- 开发一个优化意大利语言的LLM.
- 改进指令遵循和减少偏见在LLMs.
- 为了在意大利语任务上取得最先进的表现.
主要方法:
- 在英语数据集上使用监督微调 (SFT) 微调一个 8B 参数指令调整模型.
- 应用直接偏好优化 (DPO) 来调整偏好并减轻不安全的响应.
- 将模型调整为意大利语,使用高质量的意大利数据和QLoRA来提高计算效率.
主要成果:
- LLaMAntino-3-ANITA-8B-Inst-DPO-ITA在意大利LLMs中展示了最先进的表现.
- 在意大利开放的LLM基准上获得0.6160的平均准确度得分.
- 在意大利文本理解和问答任务中有效.
结论:
- 开发的LLM对意大利语言处理非常有效.
- 该方法结合了SFT,DPO和QLoRA,以实现高效和高性能的模型适应.
- 该模型在HuggingFace上公开提供,促进进一步的研究和应用.
更多相关视频
06:16Involving Individuals with Developmental Language Disorder and Their Parents/Carers in Research Priority Setting
Published on: June 6, 2020
4.6K
06:44Author Spotlight: Integrating BRET-Based Assays and Rare Mutation Analysis to Decipher RAF Kinase Regulation in Live Cells
Published on: March 1, 2024
1.8K
相关概念视频
Language
917
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
917
Components of Language
821
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
821
Language Development
916
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
916
Language and Cognition
801
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
801
What is Natural Selection?
129.5K
Natural selection is an evolutionary process in which individuals with survival-promoting traits reproduce at higher rates. These favorable traits become more common within a population or species. Naturally selected traits initially arise via random genetic mutations. In order for selection to occur, there must be variation within a population, the trait controlling the variation must be heritable, and there must be an evolutionary advantage for variation in the trait.
129.5K
Nature and Nurture
22.4K
Many human characteristics, like height, are shaped by both nature—in other words, by our genes—and by nurture, or our environment. For example, chronic stress during childhood inhibits the production of growth hormones and consequently reduces bone growth and height. Scientists estimate that 70-90% of variation in height is due to genetic differences among individuals, and 10-30% of variation in height is due to differences in the environments that individuals experience,...
22.4K
