一个基于变压器的生成对抗式学习来检测孟加拉文本中的刺话语,并对混文本进行正确的分类
Sanzana Karim Lora1, Ishrat Jahan1, Rahad Hussain2
1Department of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, Bangladesh.
Heliyon
|December 11, 2023
概括
本研究介绍了一种基于变压器的生成对抗性学习方法,用于孟加拉语刺言论的检测,克服有限的数据挑战. 基于孟加拉BERT的模型在多个数据集中实现了最高的准确性.
科学领域:
- 自然语言处理自然语言处理.
- 计算语言学 计算语言学
- 人工智能的人工智能
背景情况:
- 孟加拉语的刺言论检测研究受到高质量的注释数据集稀缺的严重限制.
- 获取用于刺言论检测的标记数据既昂贵又耗时,阻碍了该领域的进展.
研究的目的:
- 开发一种基于变压器的生成对抗性学习模型,以有效地检测孟加拉文本中的刺言论.
- 通过利用可用的资源和构建新的数据集,应对有限的标记数据的挑战.
- 在不同的孟加拉文本来源上评估拟议模型的稳定性和性能.
主要方法:
- 使用基于变压器的生成对抗性学习框架,适用于刺言论的检测.
- 使用现有的孟加拉语刺数据集"Ben-Sarc"进行初始模型培训和评估.
- 从YouTube评论和报纸文章构建了一个新的数据集,以评估模型的概括性.
- 使用"孟加拉Sarc"数据集验证了模型的稳定性.
主要成果:
- 基于孟加拉BERT的生成对抗模型在"Ben-Sarc"数据集上实现了最高准确率77.1%.
- 该模型在新建的数据集上表现出强的表现,达到68.2%的准确性.
- 在"BanglaSarc"数据集上记录了97.2%的特殊准确性,证实了模型的稳定性.
结论:
- 基于变压器的生成对抗性学习提供了一个可行的解决方案,以有限的数据来检测孟加拉语刺.
- 拟议的基于孟加拉语BERT的模型显示了在各种孟加拉文本来源中准确识别刺言论的重大前景.
- 进一步的研究和数据集开发可以提高自动刺言论检测在低资源语言的能力.
相关概念视频
Stereotype Content Model
14.7K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.7K
Types Of Transformers
979
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
979
Improving Translational Accuracy
11.0K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.0K
Classification of Systems-I
188
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
188
Types of Errors: Detection and Minimization
1.6K
Error is the deviation of the obtained result from the true, expected value or the estimated central value. Errors are expressed in absolute or relative terms.
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
1.6K
Classification of Systems-II
149
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
149


