一个用于将本地孟加拉语 (Sylheti) 方言翻译成标准孟加拉语的数据集
Tabia Tanzin Prama1, Mangsura Kabir Oni1
1Jahangirnagar University, Dhaka 1342, Bangladesh.
Data in brief
|March 9, 2026
概括
创建了一个新的Sylheti和标准孟加拉语配对句子数据集,以改善Sylheti语言的神经机器翻译 (NMT) 和其他自然语言处理任务.
科学领域:
- 计算语言学 计算语言学
- 自然语言处理自然语言处理.
- 机器翻译 机器翻译
背景情况:
- 全球1100万人使用的西尔赫蒂语缺乏数字资源和正式代表.
- 有效的沟通需要在Sylheti方言和标准孟加拉语之间进行翻译.
- 西尔赫提现有的语言资源有限,阻碍了技术发展.
研究的目的:
- 为了介绍一套新的数据集,配对Sylheti和标准孟加拉语句子.
- 增强Sylheti和标准孟加拉语之间的神经机器翻译 (NMT) 能力.
- 为了支持Sylheti语言的各种自然语言处理 (NLP) 任务.
主要方法:
- 从各种来源收集了5002个句子对,包括报纸,社交媒体和母语贡献.
- 确保数据多样性,包括独特的单词,句子和句子.
- 在2023年12月至2025年3月期间编制的数据集.
主要成果:
- 数据集包括10,004个句子,21,132个单词和10,340个句子.
- 包括9729个独特的西尔赫蒂语单词和11,403个独特的标准孟加拉语单词.
- 为NMT,文本分类,情绪分析等提供了宝贵的资源.
结论:
- 这一数据集是Sylheti语言技术的重大进步.
- 它有助于在数字领域更好地理解和利用Sylheti.
- 允许开发先进的NLP工具,如Sylheti的文本转语和语言模型.
更多相关视频
12:49Transcranial Direct Current Stimulation tDCS of Wernicke's and Broca's Areas in Studies of Language Learning and Word Acquisition
Published on: July 13, 2019
18.1K
09:00Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
Published on: August 16, 2024
1.3K
相关概念视频
02:07Improving Translational Accuracy
3.7K
3.7K
02:07Improving Translational Accuracy
15.3K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
15.3K
01:31Translation
21.3K
Translation is the process of synthesizing proteins from the genetic information carried by messenger RNA (mRNA). Following transcription, it constitutes the final step in the expression of genes. This process is carried out by ribosomes, complexes of protein and specialized RNA molecules. Ribosomes, transfer RNA (tRNA), and other proteins produce a chain of amino acids—the polypeptide—as the end product of translation.
Translation Produces the Building Blocks of Life
Proteins are...
Translation Produces the Building Blocks of Life
Proteins are...
21.3K
01:31Translation
158.7K
Lesson: Translation
Translation is the process of synthesizing proteins from the genetic information carried by messenger RNA (mRNA). Following transcription, it constitutes the final step in the expression of genes. This process is carried out by ribosomes, complexes of protein and specialized RNA molecules. Ribosomes, transfer RNA (tRNA), and other proteins produce a chain of amino acids—the polypeptide—as the end product of translation.
Translation Produces the Building Blocks of...
Translation is the process of synthesizing proteins from the genetic information carried by messenger RNA (mRNA). Following transcription, it constitutes the final step in the expression of genes. This process is carried out by ribosomes, complexes of protein and specialized RNA molecules. Ribosomes, transfer RNA (tRNA), and other proteins produce a chain of amino acids—the polypeptide—as the end product of translation.
Translation Produces the Building Blocks of...
158.7K
01:12Sampling Distribution
18.7K
Given simple random samples of size n from a given population with a measured characteristic such as mean, proportion, or standard deviation for each sample, the probability distribution of all the measured characteristics is called a sampling distribution. How much the statistic varies from one sample to another is known as the sampling variability of a statistic. You typically measure the sampling variability of a statistic by its standard error. The standard error of the mean is an example...
18.7K
01:53Bacterial Transcription
37.9K
RNA polymerase (RNAP) carries out DNA-dependent RNA synthesis in both bacteria and eukaryotes. Bacteria do not have a membrane-bound nucleus. So, transcription and translation occur simultaneously, on the same DNA template.
Transcription can be divided into three main stages, each involving distinct DNA sequences to guide the polymerase. These are:
Transcription can be divided into three main stages, each involving distinct DNA sequences to guide the polymerase. These are:
37.9K