阿迪安:为索拉尼库尔德语语言自动注释命名实体识别数据集
Chovyan H Wahid1,2, Rebwar M Nabi3,2
1Computer Department, College of Science, Charmo University, Sulaymaniyah, Iraq.
Data in brief
|September 16, 2025
概括
研究人员开发了第一个索拉尼库尔德语命名实体识别 (NER) 数据集,对于推进这种低资源语言的自然语言处理 (NLP) 工具至关重要.
科学领域:
- 计算语言学 计算语言学
- 自然语言处理自然语言处理.
- 数据科学数据科学数据科学
背景情况:
- 库尔德语等资源较少的语言在自然语言处理 (NLP) 中面临重大挑战,原因是注释数据集的稀缺性.
- 索拉尼库尔德语现有的NLP资源有限,阻碍了先进语言技术的发展.
- 命名实体识别 (NER) 是NLP的一个基本任务,对于信息提取和理解文本至关重要.
研究的目的:
- 引入第一个高质量的,自动注释的索拉尼库尔德语命名实体识别 (NER) 数据集.
- 为解决在NLP领域中索拉尼库尔德语语言注释资源的严重缺乏.
- 为推进NLP研究和低资源语言的应用提供有价值的资源.
主要方法:
- 收集了2024年出版的认可媒体的当代索拉尼库尔德语新闻文章.
- 使用了基于词典的方法,用于实体注释的种子词.
- 应用了BIO (Begin,Inside,Outside) 标签方案,以确保NER模型的兼容性.
- 通过仔细选择和一致的注释程序来确保数据质量.
主要成果:
- 开发并发布了"Adyan"数据集,这是第一个自动注释的索拉尼库尔德语NER集体.
- 该数据集涵盖了各种领域,包括政治,经济,体育,健康,文化和技术.
- 数据集以TXT格式提供,以促进可访问性和整合到各种NLP工作流.
结论:
- 阿迪安数据集对低资源语言的NLP资源做出了重大贡献,特别是索拉尼库尔德语.
- 预计这项资源将加速NER的研究,情绪分析,机器翻译和库尔德语文本分类.
- 该数据集的公开发布旨在促进库尔德语NLP的进一步发展和创新.
相关概念视频
03:36Genome Annotation and Assembly
20.5K
The genome refers to all of the genetic material in an organism. It can range from a few million base pairs in microbial cells to several billion base pairs in many eukaryotic organisms. Genome assembly refers to the process of taking the DNA sequencing data and putting it all back together in a correct order to create a close representation of the original genome. This is followed by the identification of functional elements on the newly assembled genome, a process called genome annotation.
20.5K
01:11Nomenclature of Aromatic Compounds with Multiple Substituents
10.3K
When more than one substituent is present on the benzene ring, the IUPAC nomenclature depends on the number of substituents present.
For disubstituted benzene derivatives, with two groups attached to the benzene ring, three constitutional isomers are possible. For example, consider dimethyl benzene, often called xylene, where the second methyl group can be substituted at the second, third, or fourth carbon. The relative position of the substituents is represented by prefixes ortho, meta, or...
For disubstituted benzene derivatives, with two groups attached to the benzene ring, three constitutional isomers are possible. For example, consider dimethyl benzene, often called xylene, where the second methyl group can be substituted at the second, third, or fourth carbon. The relative position of the substituents is represented by prefixes ortho, meta, or...
10.3K
01:23Nomenclature of Aromatic Compounds with a Single Substituent
9.9K
Benzene is the simplest aromatic hydrocarbon or arene. The IUPAC names for simple monosubstituted benzene derivatives are derived by adding the substituent's name as a prefix to the parent benzene. For example, halobenzene, where the halogen could be fluoro (F), chloro (Cl), bromo (Br), and iodo (I).
9.9K
01:09IUPAC Nomenclature of Ketones
7.5K
Like aldehydes, ketones are named using IUPAC rules; in this case, by replacing “e” in the name of the longest hydrocarbon chain with “one.” In acyclic ketones, the ketonic carbon is given the lowest locant value. For instance, as shown below, a simple five-carbon ketone is named pentan-2-one, instead of pentan-4-one. IUPAC rules also allow the placing of the locant value before the parent name to give an alternate name, 2-pentanone.
7.5K
02:39Nomenclature of Alkynes
20.9K
Alkynes are unsaturated hydrocarbons characterized by the presence of carbon-carbon triple bonds and have a general formula CnH2n-2. The nomenclature of alkynes follows a set of rules similar to alkanes and alkenes; however, alkynes bear the suffix "-yne" instead of "-ane" or "-ene." There are two approaches to naming alkynes:
20.9K
02:22Nomenclature of Alkanes
26.0K
In the late 19th-century, the number of new chemical compounds discovered increased tremendously. Hence, the necessity arose to develop a naming system for the systematic nomenclature of these newly discovered compounds. IUPAC (International Union for Pure and Applied Chemistry), established in 1919, sets rules for the nomenclature.
The alkane nomenclature considers the length of the carbon chain, the number, and the location of the substituent to arrive at its systematic name. The IUPAC...
The alkane nomenclature considers the length of the carbon chain, the number, and the location of the substituent to arrive at its systematic name. The IUPAC...
26.0K