一个8100万字的阿拉伯书籍的多种类型的语料库
1University of Gothenburg, Department of Languages and Literatures, Box 200, 40530 Gothenburg, Sweden.
Data in brief
|April 10, 2025
概括
一个新的阿拉伯语电子书库提供了1,745本免费许可书 (81.5万字) 用于语言研究和人工智能培训. 这一资源有助于研究阿拉伯文学中的类型变化和辩证词.
科学领域:
- 计算语言学 计算语言学
- 数字人文学科 数字人文学科
- 语料库语言学 语料库语言学
背景情况:
- 对于语言研究和自然语言处理 (NLP) 模型培训,对大型,可访问的阿拉伯文文本体的需求正在增长.
- 现有的阿拉伯体可能在类型,出版日期或许可方面缺乏多样性,从而限制了它们的实用性.
- 欣达维基金会对开放访问出版的承诺为创建一个有价值的数字资源提供了机会.
研究的目的:
- 介绍和描述阿拉伯电子书集,这是一本小说,免费提供阿拉伯文本的收藏.
- 详细说明库的组成,包括大小,类型多样性和元数据.
- 突出库适用于各种语言研究,特别是基于类型的研究和AI模型开发.
主要方法:
- 由Hindawi基金会 (2008-2024) 出版的1,745本电子书 (8150万字) 的汇编.
- 根据无限制许可证选择的书籍,涵盖各种类型 (小说,非小说,诗歌等). ) 的情况.
- 将电子书 (epub) 转换为纯文本和HTML,并进行广泛的元数据提取 (标题,作者,类型,日期).
主要成果:
- 现在可以获得阿拉伯语电子书集,包括1745本书和8150万个单词.
- 该集体包括各种各样的类型和出版期,具有丰富的元数据.
- 所有包含的文本都在免费许可证下发布,使其适合重复使用.
结论:
- 阿拉伯电子书库是阿拉伯语言学和NLP的重要,免费可访问的资源.
- 它的类型多样性和元数据有助于进行深入的语言分析,包括对位变化.
- 该集体作为一个有价值的数据集,用于在开放许可证下培训阿拉伯语言模型.
更多相关视频
09:20Cloud-Based Phrase Mining and Analysis of User-Defined Phrase-Category Association in Biomedical Publications
Published on: February 23, 2019
8.6K
06:48Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment
Published on: June 25, 2019
9.0K
相关概念视频
01:13The Cochlea
44.1K
The cochlea is a coiled structure in the inner ear that contains hair cells—the sensory receptors of the auditory system. Sound waves are transmitted to the cochlea by small bones attached to the eardrum called the ossicles, which vibrate the oval window that leads to the inner ear. This causes fluid in the chambers of the cochlea to move, vibrating the basilar membrane.
44.1K
01:11Genetic Lingo
98.5K
Overview
98.5K
01:17Karyotyping
55.5K
Overview
55.5K
01:31Hearing
51.4K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
51.4K
01:31Translation
141.0K
Lesson: Translation
Translation is the process of synthesizing proteins from the genetic information carried by messenger RNA (mRNA). Following transcription, it constitutes the final step in the expression of genes. This process is carried out by ribosomes, complexes of protein and specialized RNA molecules. Ribosomes, transfer RNA (tRNA), and other proteins produce a chain of amino acids—the polypeptide—as the end product of translation.
Translation Produces the Building Blocks of...
Translation is the process of synthesizing proteins from the genetic information carried by messenger RNA (mRNA). Following transcription, it constitutes the final step in the expression of genes. This process is carried out by ribosomes, complexes of protein and specialized RNA molecules. Ribosomes, transfer RNA (tRNA), and other proteins produce a chain of amino acids—the polypeptide—as the end product of translation.
Translation Produces the Building Blocks of...
141.0K
01:33Proteomics
7.1K
A proteome is the entire set of proteins that a cell type produces. We can study proteomes using the knowledge of genomes because genes code for mRNAs, and the mRNAs encode proteins. Although mRNA analysis is a step in the right direction, not all mRNAs are translated into proteins.
Proteomics is the study of proteomes' function. It involves the large-scale systematic study of the proteome to denote the protein complement expressed by a genome. Scientist Mark Wilkins coined the term...
Proteomics is the study of proteomes' function. It involves the large-scale systematic study of the proteome to denote the protein complement expressed by a genome. Scientist Mark Wilkins coined the term...
7.1K