相关实验视频

Updated: Jun 15, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

对预训练的语言模型进行比较评估,用于生物医学信息检索

Franziska Weber¹, Dennis Toddenroth¹

¹Medical Informatics, University Erlangen-Nuremberg, Germany.

Studies in health technology and informatics

|August 23, 2024

概括

句子-BERT向量化在生物医学信息检索方面略高于交叉编码器和ColBERT. 在OHSUMED数据集上微调这些算法为搜索查询相关性估计提供了最小的改进.

科学领域:

生物医学信息学生物医学信息学
信息检索信息检索
自然语言处理自然语言处理.

背景情况:

有效的信息检索 (IR) 对于导航广的生物医学文献至关重要.
预训练的语言模型为搜索查询和文档提供先进的矢量表示.
像交叉编码器,SentenceBERT和ColBERT这样的算法利用这些模型进行IR.

研究的目的:

评估交叉编码器,SentenceBERT和ColBERT在估计生物医学文档与搜索查询相关性的有效性.
为了比较这些向量化算法的性能,使用OHSUMED数据集.
评估微调对算法性能的影响.

主要方法:

使用OHSUMED数据集来评估信息检索算法.
使用交叉编码器,SentenceBERT和ColBERT来生成矢量表示.
将算法计算的相关性得分与使用盒子图和斯皮尔曼等级相关性的相关性标签进行了比较.

主要成果:

与交叉编码器和ColBERT相比,句子-BERT表现出中等的优异性.
在OHSUMED标签的子集上进行额外的微调,对性能产生了微不足道的好处.
矢量化算法在估计相关性方面显示了不同程度的成功.

结论:

句子-BERT是一个有前途的向量化算法用于生物医学信息检索任务.
目前的微调策略为这些特定的算法和数据集提供了有限的优势.
为了系统的优化和最终用户评估,需要对更大,专用数据集进行进一步的研究.

关键词:

生物医学信息检索获取科尔伯特·科尔伯特 (Colbert) 是一个著名的作家.这是一个交叉编码器.这就是OHSUMED的意思.一句话 - - 伯特.

更多相关视频

Cloud-Based Phrase Mining and Analysis of User-Defined Phrase-Category Association in Biomedical Publications

Cloud-Based Phrase Mining and Analysis of User-Defined Phrase-Category Association in Biomedical Publications

Published on: February 23, 2019

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model

Published on: August 16, 2020

相关概念视频

Leaky Scanning

Leaky Scanning

During most eukaryotic translation processes, the small 40S ribosome subunit scans an mRNA from its 5' end until it encounters the first start AUG codon. The large 60S ribosomal subunit then joins the smaller one to initiate protein synthesis. The location of the translation initiation is largely determined by the nucleotides near the start codon as there may be multiple translation initiation sites present on the mRNA. Marilyn Kozak discovered that the sequence RCCAUGG (where R...

Improving Translational Accuracy

Improving Translational Accuracy

Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...

Combination Therapies and Personalized Medicine

Combination Therapies and Personalized Medicine

Combining two or more treatment methods increases the life span of cancer patients while reducing damage to vital organs or tissue from the overuse of a single treatment. Combination therapy also targets different cancer-inducing pathways, thus reducing the chances of developing resistance to treatment.
The combination of the drug acetazolamide and sulforaphane is a good example of combination therapy to treat cancer. The cells in the interior of a large tumor often die due to the hypoxic and...