使用微调BiLSTM框架检测乌尔都语文的副词检测
Muhammad Ali Aslam1, Khairullah Khan1, Wahab Khan1
1Department of Computer Science, University of Science and Technology, Bannu, 28100, Pakistan.
Scientific reports
|May 2, 2025
概括
这项研究引入了一种新的双向长期短期记忆 (BiLSTM) 框架,用于乌尔都语的自动化转句检测,在定制的语料库上达到94.14%的准确性. 这项研究还提出了一个大规模的乌尔都语拼写体 (UPC),以推进NLP研究.
科学领域:
- 自然语言处理 (NLP) 是一种自然语言处理.
- 计算语言学 计算语言学
- 人工智能 (AI) 是一种人工智能.
背景情况:
- 自动转述检测对于NLP任务,如总结和抄袭检测至关重要.
- 由于复杂的形态学,脚本和有限的资源,乌尔都语释检测面临着挑战.
- 现有的方法与乌尔都语的语言细微差别作斗争.
研究的目的:
- 开发一个强大的框架来检测乌尔都语的重复表达.
- 为了解决乌尔都语语言的复杂性,在表述识别中.
- 为乌尔都语NLP研究创造一个有价值的资源.
主要方法:
- 提出了一个新的双向长期短期记忆 (BiLSTM) 框架.
- 使用了词嵌入和文本预处理 (标记化,停止词删除,标签编码).
- 开发了一个大规模的乌尔都语抄本库 (UPC),包含15万个手动验证的抄本对.
主要成果:
- 在定制的UPC数据集上,BiLSTM模型实现了94.14%的准确性.
- 超越了卷积神经网络 (CNN) 的83.43%和长期短期记忆 (LSTM) 的88.09%.
- 在基准Quora数据集上达到95.34%的准确性,证明了广泛的适用性.
结论:
- 拟议的BiLSTM框架显著提高了乌尔都语转述检测性能.
- 创建的乌尔都语抄本库 (UPC) 作为未来研究的关键资源.
- 对于特殊情况下,语言规则引擎增强了模型的稳定性.
相关概念视频
Improving Translational Accuracy
2.5K
2.5K
Difference from Background: Limit of Detection
4.6K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
4.6K
Upsampling
159
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
159
Master Transcription Regulators
2.2K
2.2K
Detection of Gross Error: The Q Test
4.4K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
4.4K
Leaky Scanning
5.0K
During most eukaryotic translation processes, the small 40S ribosome subunit scans an mRNA from its 5' end until it encounters the first start AUG codon. The large 60S ribosomal subunit then joins the smaller one to initiate protein synthesis. The location of the translation initiation is largely determined by the nucleotides near the start codon as there may be multiple translation initiation sites present on the mRNA. Marilyn Kozak discovered that the sequence RCCAUGG (where R...
5.0K


