最新消息:揭示了葡萄牙新闻分类和对方法的比较分析的新数据集
Klaifer Garcia1, Pedro Shiguihara2, Lilian Berton1
1Department of Science and Technology, Federal University of Sao Paulo, São José dos Campos, São Paulo, Brazil.
PloS one
|January 26, 2024
概括
本研究介绍了新的葡萄牙新闻数据集,并比较了各种文本分类方法,包括BERT,用于分析新闻内容. 该研究强调了葡萄牙新闻分类的准确性和培训时间之间的权衡.
科学领域:
- 自然语言处理自然语言处理.
- 计算语言学 计算语言学
- 信息检索 信息检索
背景情况:
- 新闻分类对于从大量在线信息中提取知识至关重要.
- 大多数现有的新闻分类研究都集中在英语文档上,为其他语言留下了一个空白.
- 多种数据集的可用性对于推进跨语言文本分析研究至关重要.
研究的目的:
- 引入一个新的,多来源的葡萄牙语新闻数据集,以解决这个语言的资源稀缺问题.
- 为了比较葡萄牙新闻的各种文本表示技术 (字袋,TF-IDF,嵌入) 和分类算法 (SVM,CNN,DJINN,BERT) 的性能.
- 分析不同新闻分类方法的准确性和计算效率权衡.
主要方法:
- 来自维基新闻的新葡萄牙新闻数据集的开发,涵盖各种新闻媒体.
- 实施和评估经典 (SVM) 和深度学习 (CNN,BERT) 模型用于文本分类.
- 使用不同文本表示形式进行比较分析:字袋 (BoW),TF-IDF和词嵌入.
主要成果:
- 该研究对各种机器学习和深度学习模型进行了全面的比较,用于葡萄牙新闻分类.
- 结果显示了不同文本表示和分类架构之间的性能变化.
- 关键发现揭示了分类准确性和训练模型所需的计算时间之间的权衡.
结论:
- 新推出的葡萄牙新闻数据集有助于进一步研究资源不足语言的自然语言处理.
- 伯特和其他先进的模型对葡萄牙新闻分类有希望,尽管经典方法提供了更简单的替代方案.
- 了解模型复杂性,准确性和训练效率之间的平衡对于实际的新闻分类应用至关重要.
相关概念视频
01:29Aggregates Classification
326
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
326
01:30Classification of Signals
462
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
462
01:26Classification of Systems-I
186
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
186
01:31Classification of Systems-II
146
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
146
01:11Statistical Analysis: Overview
6.6K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
6.6K
01:25Statistical Methods for Analyzing Epidemiological Data
366
Epidemiological data primarily involves information on specific populations' occurrence, distribution, and determinants of health and diseases. This data is crucial for understanding disease patterns and impacts, aiding public health decision-making and disease prevention strategies. The analysis of epidemiological data employs various statistical methods to interpret health-related data effectively. Here are some commonly used methods:
366