ChatgaiyyaAlap:一个数据集用于从奇塔戈尼亚方言转换为标准孟加拉语
Sinthia Chowdhury1, Deawan Rakin Ahamed Remal1, Syed Tangim Pasha2
1Department of Computer Science and Engineering, Daffodil International University, Birulia, Savar, Dhaka 1216, Bangladesh.
Data in brief
|March 21, 2025
概括
这项研究介绍了"ChatgaiyyaAlap",这是孟加拉语研究的新数据集,包含4012个标准孟加拉语和奇塔戈尼亚方言之间的翻译句子. 这个资源有助于比较语言学和AI开发孟加拉语.
科学领域:
- 计算语言学 计算语言学
- 自然语言处理自然语言处理.
- 社会语言学 社会语言学
背景情况:
- 孟加拉语是一个广泛使用的语言,在孟加拉国有显著的方言多样性.
- 标准孟加拉语是官方形式,但在日常沟通中普遍存在地区方言.
- 奇塔哥尼亚方言缺乏书面形式,呈现出与标准孟加拉语独特的语言变异.
研究的目的:
- 为研究孟加拉语方言创建一个有价值的数据集,特别关注奇塔哥尼亚语方言.
- 促进比较语言学研究和开发孟加拉语翻译智能系统.
- 为满足对语言资源的需求,以捕捉口语孟加拉方言的细微差别.
主要方法:
- 在线来源 (YouTube,Facebook) 中编译了4012个标准孟加拉语和奇塔哥尼亚方言的独特句子对.
- 数据清理过程涉及删除表情符号,标点符号和多余的空白.
- 开发一本含有1500对单词的双语词典,以确保数据的准确性和解决模两可的问题.
主要成果:
- "ChatgaiyyaAlap"数据集突出了标准孟加拉语和奇塔哥尼亚方言之间拼写和句子结构的显著差异.
- 附带的词典揭示了大量的词汇变化,并有助于理解语言的模两可.
- 数据集有效地证明了语言的多样性,特别是在消极句子构造方面.
结论:
- "ChatgaiyyaAlap"数据集和字典是比较语言学和AI研究人员的关键资源.
- 这些资源可以用于培训机器翻译模型和开发孟加拉语的智能系统.
- 该项目有助于保护和理解孟加拉语中丰富的语言多样性.
更多相关视频
07:58Laboratory Techniques Used to Maintain and Differentiate Biotypes of Vibrio cholerae Clinical and Environmental Isolates
Published on: May 30, 2017
10.9K
08:09A Novel Method for the Pentosan Analysis Present in Jute Biomass and Its Conversion into Sugar Monomers Using Acidic Ionic Liquid
Published on: June 1, 2018
7.2K
相关概念视频
01:36Conversion of Units
21.6K
Sometimes, there is a need to convert from one unit to another one. For instance, reading a cookbook in which quantities are expressed in units of liters or ounces may require conversion of quantities to cups. Or, when looking up directions on how to get to a location, we may be interested to know how many miles we are going to walk. In this case, we would have to convert units of feet or meters to miles.
The first step in the unit conversion is to list the given units and the units required...
The first step in the unit conversion is to list the given units and the units required...
21.6K
02:07Improving Translational Accuracy
2.5K
2.5K
02:08Gene Conversion
2.2K
2.2K
01:11Genetic Lingo
98.9K
Overview
98.9K
02:25Chirality
22.7K
Chirality is a term that describes the lack of mirror symmetry in an object. In other words, chiral objects cannot be superposed on their mirror images. For example, our feet are chiral, as the mirror image of the left foot, the right foot, cannot be superposed on the left foot.
Chiral objects exhibit a sense of handedness when they interact with another chiral object. For example, our left foot can only fit in the left shoe and not in the right shoe. Achiral objects — objects that have...
Chiral objects exhibit a sense of handedness when they interact with another chiral object. For example, our left foot can only fit in the left shoe and not in the right shoe. Achiral objects — objects that have...
22.7K
01:15Chebyshev's Theorem to Interpret Standard Deviation
4.1K
Chebyshev’s theorem, also known as Chebyshev’s Inequality, states that the proportion of values of a dataset for K standard deviation is calculated using the equation:
4.1K