DarNERcorp:在摩洛哥方言中使用注释式命名实体识别数据集
Hanane Nour Moussa1, Asmaa Mourhir1
1School of Science and Engineering, Al Akhawayn University in Ifrane, P.O. Box 104, Hassan II Avenue, Ifrane 53000, Morocco.
Data in brief
|June 29, 2023
概括
DarNERcorp是一个新的数据集,用于在摩洛哥达里贾语中进行命名实体识别 (NER). 这个资源通过提供方言和混合阿拉伯语的注释数据来帮助阿拉伯自然语言处理 (NLP).
科学领域:
- 自然语言处理自然语言处理.
- 计算语言学 计算语言学
- 语料库的语言学.
背景情况:
- 注释体对于开发强大的自然语言处理 (NLP) 系统至关重要.
- 现有的阿拉伯NLP资源往往缺乏足够的方言数据,特别是在摩洛哥的达里贾.
- 命名实体识别 (NER) 是一个基本的NLP任务,需要高质量的注释数据集.
研究的目的:
- 介绍DarNERcorp,这是一个新的手动注释数据集,用于以摩洛哥方言 (Darija) 的命名实体识别 (NER).
- 为解决方言阿拉伯语注释体的稀缺问题,特别是用于NLP应用.
- 为达里贾语和混合阿拉伯语提供培训和评估NER系统的宝贵资源.
主要方法:
- 数据收集包括从维基百科的摩洛哥方言部分取内容.
- 使用BIO (开始,内部,外部) 标记方案手动注释65,905个令牌.
- 使用开源库和用于数据处理和注释的工具.
主要成果:
- 在DarNERcorp数据集中,有65,905个有BIO标签的代币.
- 13.8%的代币被确定为四个类别的命名实体:人,地点,组织和各种.
- 该数据集为方言阿拉伯语NER提供了一个全面的资源.
结论:
- DarNERcorp代表了对阿拉伯NLP社区的重大贡献,填补了方言注释 corpora.的空白.
- 该数据集使 NER 系统的开发和对摩洛哥达里贾进行基准测试成为可能.
- 它促进了处理和理解混合和方言阿拉伯文本的进步.
相关概念视频
01:23Nomenclature of Aromatic Compounds with a Single Substituent
8.3K
Benzene is the simplest aromatic hydrocarbon or arene. The IUPAC names for simple monosubstituted benzene derivatives are derived by adding the substituent's name as a prefix to the parent benzene. For example, halobenzene, where the halogen could be fluoro (F), chloro (Cl), bromo (Br), and iodo (I).
8.3K
01:11Nomenclature of Aromatic Compounds with Multiple Substituents
8.0K
When more than one substituent is present on the benzene ring, the IUPAC nomenclature depends on the number of substituents present.
For disubstituted benzene derivatives, with two groups attached to the benzene ring, three constitutional isomers are possible. For example, consider dimethyl benzene, often called xylene, where the second methyl group can be substituted at the second, third, or fourth carbon. The relative position of the substituents is represented by prefixes ortho, meta, or...
For disubstituted benzene derivatives, with two groups attached to the benzene ring, three constitutional isomers are possible. For example, consider dimethyl benzene, often called xylene, where the second methyl group can be substituted at the second, third, or fourth carbon. The relative position of the substituents is represented by prefixes ortho, meta, or...
8.0K
01:12Nomenclature of Secondary and Tertiary Amines
4.0K
The secondary and tertiary amines are derivatives of ammonia, where two and three of its hydrogens are replaced by alkyl groups, respectively. Secondary and tertiary amines can be symmetrical with identical alkyl groups attached to the nitrogen atom or unsymmetrical when more than one type of alkyl group is present. The standard nomenclature of secondary and tertiary amines is similar to the names given to the primary amines. They are generally named alkylamines. As depicted in Figure 1, for...
4.0K
02:22Nomenclature of Alkanes
22.1K
In the late 19th-century, the number of new chemical compounds discovered increased tremendously. Hence, the necessity arose to develop a naming system for the systematic nomenclature of these newly discovered compounds. IUPAC (International Union for Pure and Applied Chemistry), established in 1919, sets rules for the nomenclature.
The alkane nomenclature considers the length of the carbon chain, the number, and the location of the substituent to arrive at its systematic name. The IUPAC...
The alkane nomenclature considers the length of the carbon chain, the number, and the location of the substituent to arrive at its systematic name. The IUPAC...
22.1K
02:29Nomenclature of Alkenes
12.2K
The IUPAC naming system for alkenes replaces -an- with -en- in the corresponding parent alkanes. Accordingly, a simple alkene replaces the -ane suffix of the alkane with -ene.
As per the IUPAC rules, the longest carbon chain containing the maximum number of double bonds is identified as the parent chain and is numbered such that the doubly bonded carbon atoms receive the lowest possible numbers. The location of the double bond is indicated by the number of its first carbon atom. In branched...
As per the IUPAC rules, the longest carbon chain containing the maximum number of double bonds is identified as the parent chain and is numbered such that the doubly bonded carbon atoms receive the lowest possible numbers. The location of the double bond is indicated by the number of its first carbon atom. In branched...
12.2K
01:10Nomenclature of Aryl and Heterocyclic Amines
2.4K
The simplest aromatic amine is phenylamine, which contains an –NH2 functionality directly attached to an aromatic ring. The name aniline is designated for this skeleton. As shown in Figure 1, the common names of the functionalized anilines involve prefixes ortho-, meta-, and para- to indicate the substitution position. Different functionalized aniline derivatives also have notable trivial names.
2.4K