从分数到洞察力:使用可靠的指标和斯拉夫语言的语言类型学预测MT错误
Dasa Munkova1, Lucia Benkova1, Michal Munk1,2
1Constantine the Philosopher University in Nitra, Nitra, Slovakia.
MethodsX
|January 6, 2026
概括
本研究引入了一种用于评估斯洛伐克语机器翻译 (MT) 质量的新方法. 它可以预测特定的错误类型,提高准确性,减少低资源语言的人力资源.
科学领域:
- 计算语言学 计算语言学
- 自然语言处理自然语言处理.
- 机器翻译评估 机器翻译评估
背景情况:
- 机器翻译 (MT) 评估对于斯洛伐克语等资源较少的语言至关重要.
- 当前的自动化方法提供单一的得分,缺少详细的错误洞察.
- 评估形态丰富的语言带来了独特的挑战.
研究的目的:
- 开发一种基于语言的方法来预测MT错误类别.
- 提高自动MT评估的可解释性和可靠性.
- 为了减少人类在复杂语言的质量评估方面的努力.
主要方法:
- 一个修改的多维质量指标 (MQM) 框架,适应斯洛伐克语.
- 手动注释与68个自动评估指标的集成.
- 开发引导后勤回归模型来预测错误概率.
主要成果:
- 通过手动注释识别了五个基于语言的错误类别.
- 使用统计措施评估68个自动指标的可靠性.
- 成功预测MT错误发生概率.
结论:
- 拟议的方法弥合了整体评分和详细错误分类之间的差距.
- 它在MT评估中提供了更好的解释性和可靠性.
- 在保持斯洛伐克语MT的语言精度的同时,大大减少了人力资源.
更多相关视频
相关概念视频
Improving Translational Accuracy
3.5K
3.5K
Improving Translational Accuracy
14.1K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
14.1K
Types of Errors: Detection and Minimization
9.5K
Error is the deviation of the obtained result from the true, expected value or the estimated central value. Errors are expressed in absolute or relative terms.
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
9.5K
Accuracy and Errors in Hypothesis Testing
558
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
558
Systematic Error: Methodological and Sampling Errors
8.6K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
8.6K
Random and Systematic Errors
14.3K
Scientists always try their best to record measurements with the utmost accuracy and precision. However, sometimes errors do occur. These errors can be random or systematic. Random errors are observed due to the inconsistency or fluctuation in the measurement process, or variations in the quantity itself that is being measured. Such errors fluctuate from being greater than or less than the true value in repeated measurements. Consider a scientist measuring the length of an earthworm using a...
14.3K


