机器翻译培训数据为英语-Tshivenḓa
Tanja Gaustad1, Cindy A McKellar1, Martin J Puttkammer1
1Centre for Text Technology (CTexT), North-West University, 11 Hoffman Street, Potchefstroom, South Africa.
Data in brief
|September 24, 2024
概括
这项研究为机器翻译提供了一个新的英语-Tshivenḓa平行语料库. 该数据集包括网络抓取和专业翻译的数据,有助于提文语语言技术的发展.
科学领域:
- 计算语言学 计算语言学
- 自然语言处理自然语言处理.
- 非洲语言 非洲语言
背景情况:
- 机器翻译 (MT) 系统需要大型,高质量的并行体来进行有效的培训.
- 在历史上,在南非使用的Tshivenḓa语言缺乏足够的数字资源来完成先进的NLP任务.
研究的目的:
- 描述一个新的平行语库的创建和特征,用于英语-Tshivenḓa机器翻译.
- 为开发Tshivenḓa MT系统和其他语言技术提供有价值的资源.
主要方法:
- 通过搜索南非政府网站和出版商的匹配文件收集数据.
- 通过专业翻译英语数据到 Tshivenḓa 来增加库.
- 关于数据对齐,语料库清理和单词计数统计的详细信息.
主要成果:
- 编制了大量的英语-Tshivenḓa数据的平行数据库.
- 该集体包括对齐的并行句子和单语言的Tshivenḓa文本.
- 数据经历了严格的清理和调整过程.
结论:
- 开发的数据集对Tshivenḓa语言资源做出了重大贡献.
- 这个语料库可以用于训练机器翻译模型和推进 Tshivenḓa 核心技术.
- 这些数据还支持语言研究和开发其他 Tshivenḓa NLP 工具.
更多相关视频
相关概念视频
Translation
14.7K
Translation is the process of synthesizing proteins from the genetic information carried by messenger RNA (mRNA). Following transcription, it constitutes the final step in the expression of genes. This process is carried out by ribosomes, complexes of protein and specialized RNA molecules. Ribosomes, transfer RNA (tRNA), and other proteins produce a chain of amino acids—the polypeptide—as the end product of translation.
Translation Produces the Building Blocks of Life
Proteins are...
Translation Produces the Building Blocks of Life
Proteins are...
14.7K
Improving Translational Accuracy
2.5K
2.5K
Initiation of Translation
6.3K
6.3K
Termination of Translation
5.4K
5.4K
Transfer RNA Synthesis
11.9K
One of the unique features of tRNA is the presence of modified bases. In some tRNAs, modified bases account for nearly 20% of the total bases in the molecule. Altogether, these unusual bases protect the tRNA from enzymatic degradation by RNases.
Each of these chemical modifications is carried by a specific enzyme, post-transcription. All of these enzymes have unique base and site-specificity. Methylation, the most common chemical modification, is carried by at least nine different enzymes, with...
Each of these chemical modifications is carried by a specific enzyme, post-transcription. All of these enzymes have unique base and site-specificity. Methylation, the most common chemical modification, is carried by at least nine different enzymes, with...
11.9K
tRNA Activation
6.7K
6.7K


