孟加拉语新闻文章数据集
Asif Mohammed Saad1, Umme Niraj Mahi1, Md Shahidul Salim1
1Khulna University of Engineering & Technology, Khulna 9203, Bangladesh.
Data in brief
|September 18, 2024
概括
这项研究引入了一个全面的孟加拉新闻数据集,包含超过190万篇文章. 该资源支持孟加拉自然语言处理和特定领域的大型语言模型的进步.
科学领域:
- 自然语言处理 (NLP) 是一种自然语言处理.
- 数据科学数据科学数据科学
- 计算语言学 计算语言学
背景情况:
- 一个新的,广泛的孟加拉语新闻数据集已经从九个主要新闻来源中编制出来.
- 该数据集包括体育,经济,政治和技术等多个类别的超过190万篇文章.
- 它包括各种属性,如每个文章的标题,内容,发布时间,标签和元信息.
研究的目的:
- 为NLP研究提供一个更新的,大规模的孟加拉语新闻数据集.
- 为孟加拉国促进开发特定领域的人工智能模型.
- 为了使数据科学家能够研究孟加拉语语言理论.
主要方法:
- 从九个知名新闻网站收集了超过190万篇孟加拉新闻文章.
- 在各种领域分类文章,包括体育,经济,政治,技术,健康和艺术.
- 用标题,内容,时间,标签,元和类别等属性对数据集进行结构化.
主要成果:
- 一个庞大的孟加拉语新闻数据集,包含超过190万篇文章.
- 该数据集包括对NLP任务至关重要的各种属性.
- 数据涵盖了广泛的新闻类别.
结论:
- 提出的孟加拉语数据集是NLP社区的宝贵资源.
- 它将加速孟加拉语NLP的研究和为孟加拉国量身定制的AI模型的创建.
- 数据集支持机器学习和深度学习模型的开发,用于文章分类.
相关概念视频
Responses to Drought and Flooding
10.2K
Water plays a significant role in the life cycle of plants. However, insufficient or excess of water can be detrimental and pose a serious threat to plants.
10.2K
Data Collection by Survey
7.6K
The systematic method of obtaining and analyzing accurate information of a population is called data collection. A survey is a standard method of data collection that involves collecting information from a target human population about their experience, opinion, or knowledge of a product, service, or process. The responses are recorded and interpreted. The most common survey examples are written questionnaires, face-to-face or telephonic conversations, focus groups, and electronic (e-mail or...
7.6K
Bar Graph
17.3K
A bar graph is also called a bar chart and consists of bars that are separated from each other. It either uses horizontal or vertical bars to show comparisons among categories. The bars can be rectangles, or they can be rectangular boxes (used in three-dimensional plots). One axis of the graph represents the specific categories being compared, and the other axis shows a discrete value. In this graph, the length of the bar for each category is proportional to the number or percent of individuals...
17.3K
Applications of Normal Distribution
7.7K
The normal distribution is a useful statistical tool. One of its practical applications is determining the door height after considering the normal distribution of heights of persons, such that many can pass through it easily without striking their heads. The normal distribution can also determine the probability of a person having a height less than a specific height.
The heights of 15 to 18-year-old males from Chile from 1984 to 1985 followed a normal distribution. The mean height is 172.36...
The heights of 15 to 18-year-old males from Chile from 1984 to 1985 followed a normal distribution. The mean height is 172.36...
7.7K
Data: Types and Distribution
2.2K
In biostatistics, data are the observations collected for analysis. There are two main types: parametric and non-parametric. Parametric data, which include continuous (e.g., weight) and discrete numerical data (e.g., number of tablets), assume a particular distribution pattern, often the normal distribution. Non-parametric data do not adhere to a specific distribution and typically comprise nominal (e.g., gender) and ordinal categorical data (e.g., pain scale ratings).
Distributions in...
Distributions in...
2.2K
Bulk Density of Aggregate
1.6K
Bulk density refers to the mass of aggregate particles that would fill a unit volume. The concept of bulk density originates from the inability to pack aggregate particles in a manner that completely eliminates void spaces. Hence, the term bulk refers to the volume that encompasses both the aggregates and the voids. This measurement is crucial when aggregates are batched by volume and is used to convert quantities by mass to volume.
Most natural mineral aggregates, like sand and gravel,...
Most natural mineral aggregates, like sand and gravel,...
1.6K


