评估英语-斯洛伐克语句子的自动句子对齐方法
Frantisek Forgac1, Dasa Munkova2, Michal Munk2,3
1Faculty of Natural Sciences and Informatics, Constantine the Philosopher University in Nitra, Nitra, Slovakia. frantisek.forgac@ukf.sk.
Scientific reports
|November 18, 2023
概括
这项研究比较了英语-斯洛伐克语平行 corpora. 的五个句子对齐工具. Vecalign和Bertalign表现出卓越的性能,而双语句子调整器 (BSA) 的表现最差.
科学领域:
- 自然语言处理自然语言处理.
- 计算语言学 计算语言学
背景情况:
- 平行体对于自然语言处理 (NLP) 应用至关重要.
- 句子对齐,识别文本之间的句子对应,是创建平行 corpora的一个基本步骤.
- 现有的自动句子对齐方法包括基于长度,基于词典,基于翻译和神经网络的方法.
研究的目的:
- 为了评估Bertalign的性能与已建立的句子对齐工具相比.
- 为了比较五种不同的调整器的有效性:双语句子调整器 (BSA),Hunalign,Bleualign,Vecalign和Bertalign.
- 在定制的英语 - 斯洛伐克语平行语库上评估性能.
主要方法:
- 使用了五种不同的句子对齐工具:BSA,Hunalign,Bleualign,Vecalign和Bertalign.
- 为英语-斯洛伐克语言对开发了一个自定义的并行语料库,使用2021-2022年的文本.
- 评估了对齐器准确度和性能指标.
主要成果:
- 韦卡林和伯塔林在统计学上取得了显著的最佳表现.
- 双语句子调整器 (BSA) 的表现最差.
- 胡纳林和布莱亚林的F1成绩相似,但布莱亚林的成绩更为多样化.
结论:
- 基于评估的指标,Vecalign和Bertalign是英语-斯洛伐克语句子对齐最有效的工具.
- 该研究强调了不同自动句子对齐方法之间的性能差异.
- 进一步调查Bleualign的性能变化可能是有必要的.
相关概念视频
The Anchoring-and-Adjustment Heuristic
7.3K
In order to make good decisions, we use our knowledge and our reasoning. Often, this knowledge and reasoning is sound and solid. However, sometimes, we are swayed by biases or by others manipulating a situation. For example, let’s say you and three friends wanted to rent a house and had a combined target budget of $1,600. The realtor shows you only very run-down houses for $1,600 and then shows you a very nice house for $2,000. Might you ask each person to pay more in rent to get the...
7.3K
Improving Translational Accuracy
11.2K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.2K
Structural Classification of Joints
3.5K
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...
3.5K
Mismatch Repair
4.9K
Organisms are capable of detecting and fixing nucleotide mismatches that occur during DNA replication. This sophisticated process requires identifying the new strand and replacing the erroneous bases with correct nucleotides. Mismatch repair is coordinated by many proteins in both prokaryotes and eukaryotes.
The Mutator Protein Family Plays a Key Role in DNA Mismatch Repair
The human genome has more than 3 billion base pairs of DNA per cell. Prior to cell division, that vast amount of genetic...
The Mutator Protein Family Plays a Key Role in DNA Mismatch Repair
The human genome has more than 3 billion base pairs of DNA per cell. Prior to cell division, that vast amount of genetic...
4.9K
Sign Test for Matched Pairs
136
The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in...
To conduct the sign test, we first calculate the differences in...
136
Complementation Tests
4.9K
A complementation test is a simple cross to identify whether the two mutations are located on the same gene or different genes. It was first performed by Edward Lewis in the 1940s while working on fruit flies. He developed the test to identify the location and arrangement of different mutations on chromosomes.
Organisms heterozygous for different mutations are crossed pairwise in all combinations. If present on different genes, the mutations can complement each other by providing the missing...
Organisms heterozygous for different mutations are crossed pairwise in all combinations. If present on different genes, the mutations can complement each other by providing the missing...
4.9K


