图卡诺:为葡萄牙语推进神经文本生成
Nicholas Kluge Corrêa1, Aniket Sen2, Sophia Falk3
1Center for Science and Thought, University of Bonn, Konrad-Zuse-Platz 1-3, Bonn, 53227 North Rhine-Westphalia, Germany.
Patterns (New York, N.Y.)
|December 2, 2025
概括
研究人员开发了GigaVerbo,一个2000亿令牌的葡萄牙语语体,以及Tucano,用于神经文本生成的变压器模型. 这些资源促进了低资源语言的自然语言处理,优于现有的模型.
科学领域:
- 自然语言处理自然语言处理.
- 计算语言学 计算语言学
- 人工智能的人工智能
背景情况:
- 深度学习模型需要大量的数据和计算能力,为低资源语言创造资源缺口.
- 现有的自然语言处理 (NLP) 进步主要有利于高资源语言,而其他语言则落后.
研究的目的:
- 通过开发葡萄牙语神经文本生成资源来弥合NLP的资源差距.
- 介绍GigaVerbo,一个大型的葡萄牙语文本库,以及Tucano,一个变压器模型家族.
主要方法:
- 开发GigaVerbo,一个葡萄牙语文本体,包括200亿个令牌.
- 培训Tucano,一系列仅使用GigaVerbo集体的解码器变压器模型.
- 在各种NLP基准上对图卡诺模型与葡萄牙语和多语言基线进行评估.
主要成果:
- 与现有的葡萄牙语和多语言模型相比,图卡诺模型在多个基准测试中表现优越.
- 开发的资源,包括模型和数据集,促进了葡萄牙语NLP的可重复性研究.
结论:
- GigaVerbo体和Tucano模型代表了葡萄牙语神经文本生成的重大进步.
- 公开发布这些资源有助于进一步研究和开发低资源语言NLP.
关键词:
葡萄牙语 葡萄牙语给你一个GIVERBOBO语言建模语言建模大型语言模型.资源较少的语言.自然语言处理自然语言处理.神经文本生成神经文本生成这是开源的,开源的.图卡诺 (Tucano) 是一个城市.更多相关视频
03:14Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
994
12:49Transcranial Direct Current Stimulation tDCS of Wernicke's and Broca's Areas in Studies of Language Learning and Word Acquisition
Published on: July 13, 2019
17.8K
相关概念视频
Language Development
806
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
806
Improving Translational Accuracy
3.5K
3.5K
Improving Translational Accuracy
14.0K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
14.0K
Neural Circuits
2.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
2.6K
Neurogenesis and Regeneration of Nervous Tissue
1.5K
In the CNS, neurogenesis, the birth of new neurons from stem cells, is limited to the hippocampus in adults. In other regions of the brain and spinal cord, neurogenesis is almost non-existent due to inhibitory influences from neuroglia, especially oligodendrocytes, and the absence of growth-stimulating cues. The myelin produced by oligodendrocytes in the CNS inhibits neuronal regeneration. Furthermore, astrocytes proliferate rapidly after neuronal damage, forming scar tissue that physically...
1.5K
Neuronal Communication
2.9K
Neurons, the fundamental units of the brain and nervous system, communicate through complex electrochemical signals that underpin all cognitive and bodily functions. This communication is primarily facilitated by a process involving the generation and propagation of an action potential along the axon of the neuron. When the internal electrical charge of a neuron surpasses a certain threshold, an action potential is triggered. This rapid change in voltage travels swiftly along the axon to the...
2.9K
