使用基于变压器的模型改进 MEDLINE 引文的自动 PT 标记
1National Library of Medicine, Bethesda, Maryland, US.
ArXiv
|July 30, 2025
概括
像BERT这样的变压器模型可以准确地从引用数据中预测医学科目标题出版物类型. 这提高了自动化生物医学文献索引和检索的性能.
科学领域:
- 生物医学信息学 生物医学信息学
- 自然语言处理自然语言处理.
- 信息检索 信息检索
背景情况:
- 目前生物医学文献的自动索引依赖于过时的NLP算法.
- 在准确地分配医学主题标题 (MeSH) 出版物类型 (PT) 方面存在局限性.
研究的目的:
- 评估使用引用元数据预测MeSH PTs的可行性.
- 探索基于变压器的模型 (BERT,DistilBERT) 对此任务的有效性.
- 改进自动化生物医学文献索引和检索.
主要方法:
- 使用预先训练的变压器模型:BERT和DistilBERT.
- 评估的单体多标签分类器和二进制分类器集.
- 应用模型到 MEDLINE 引用元数据中,用于 PT 预测.
主要成果:
- 变压器模型显示了提高PT标记精度的巨大潜力.
- 提出的方法比传统的NLP算法更有前途.
- 提高准确度有助于更好地检索文献.
结论:
- 变压器模型为生物医学索引提供了可扩展和高效的方法.
- 这一进步可以显著提高PT分配的准确性.
- 这些发现为下一代自动化文献分析铺平了道路.
相关概念视频
Tagging and Fusion Proteins
6.9K
Proteins are involved in several cellular processes and biochemical reactions. Analyzing a specific protein of interest requires it to be isolated from the other proteins in the cell. This is achieved by overexpressing the specific gene in a suitable host to produce large quantities of the target protein. A tag or label is recombined with the gene to produce a fusion protein containing the target protein and the tag. The tags on these fusion proteins can then be used for easy detection and...
6.9K
Improving Translational Accuracy
2.7K
2.7K
Source Transformation
9.2K
Source transformation is a fundamental technique employed in circuit analysis, offering a valuable tool for simplifying complex electrical circuits. This technique involves the replacement of either a voltage source in series with a resistor by a current source in parallel with a resistor, or vice versa. The key concept here is that when the original sources are deactivated (turned off), the equivalent resistance at the circuit's end terminals remains the same.
It is essential to note that when...
It is essential to note that when...
9.2K
Transformers
1.2K
A device that transforms voltages from one value to another using induction is called a transformer. A transformer consists of two separate coils, or windings, wrapped around the same soft iron core. However, they are electrically insulated from each other.
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
1.2K
Classification of Neurotransmitters
3.6K
Neurotransmitters play a crucial role in the communication between neurons in the autonomic nervous system. Neurons in the autonomic nervous system can be cholinergic or adrenergic depending on the neurotransmitters synthesized. Cholinergic neurons use acetylcholine as their primary neurotransmitter. This includes all the preganglionic fibers of the sympathetic and pre- and postganglionic fibers of the parasympathetic nervous systems. In addition, neurons of the somatic nervous system also use...
3.6K
Master Transcription Regulators
2.3K
2.3K


