创建一个生物医学知识库,通过解决GPT不准确的反应和基准测试环境
S Solomon Darnell1, Rupert W Overall1,2, Andrea Guarracino1
1University of Tennessee Health Science Center, Memphis, TN, USA.
bioRxiv : the preprint server for biology
|October 28, 2024
概括
我们开发了GNQA,这是一个使用检索增强生成 (RAG) 进行衰老和痴呆症研究的生成预训练变压器 (GPT) 知识库. 该系统提高了响应的准确性,并提供可验证的参考,实现了高用户满意度和自动化相关性得分.
科学领域:
- 生物医学信息学 生物医学信息学
- 人工智能在医学中的应用
- 老年学和神经退行性疾病
背景情况:
- 像GPT这样的生成AI模型可以产生不准确的信息 ("幻觉").
- 检索增强生成 (RAG) 系统需要强大的评估方法.
- 衰老,痴呆,阿尔茨海默病和糖尿病研究需要可靠的知识基础.
研究的目的:
- 开发和评估GNQA,一个基于GPT的知识库,利用RAG进行衰老和痴呆症研究.
- 实施上下文来源跟踪机制,以确保响应的准确性和可追溯性.
- 引入RAGAS,一个用于评估RAG性能的自动化系统,结合人类和AI评估.
主要方法:
- 在RAG系统中整合了3000篇关于衰老,痴呆,阿尔茨海默氏症和糖尿病的同行评审出版物.
- 开发了一个上下文来源追踪机制,以将响应与源材料联系起来.
- 创建了RAG评估系统 (RAGAS),将人类专家和公民科学家的反与人工智能驱动的评估相结合.
主要成果:
- 人类受访者在76%的时间内批准了GNQA的回答.
- 对于专家提出的问题,RAGAS的答案相关性达到了90%,对于GPT生成的问题,答案相关性达到了74%.
- 该研究将RAGAS作为持续RAG系统性能评估的基准.
结论:
- GNQA由RAG提供动力,并通过来源跟踪进行增强,为衰老和痴呆症研究提供可靠和可验证的知识资源.
- RAGAS为评估RAG系统提供了一个强大的框架,这对于减轻人工智能产生的不准确性至关重要.
- 通过开源GeneNetwork.org网络服务访问GNQA,促进更广泛的研究可访问性.
相关概念视频
Improving Translational Accuracy
9.2K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
9.2K
Genome Annotation and Assembly
18.8K
The genome refers to all of the genetic material in an organism. It can range from a few million base pairs in microbial cells to several billion base pairs in many eukaryotic organisms. Genome assembly refers to the process of taking the DNA sequencing data and putting it all back together in a correct order to create a close representation of the original genome. This is followed by the identification of functional elements on the newly assembled genome, a process called genome annotation.
18.8K
Genomic Imprinting and Inheritance
33.4K
Diploid organisms inherit genetic material through chromosomes from both parents. Copies of the same gene are known as alleles. In most cases, both alleles are simultaneously expressed and allow various cellular processes to function optimally. If one of the alleles is missing or mutated, the expression of the other allele can compensate; however, this is not true for all genes.
The expression of some genes depends on which parent passed the gene to the offspring, through a phenomenon known as...
The expression of some genes depends on which parent passed the gene to the offspring, through a phenomenon known as...
33.4K
Genomics
36.1K
Genomics is the science of genomes: it is the study of all the genetic material of an organism. In humans, the genome consists of information carried in 23 pairs of chromosomes in the nucleus, as well as mitochondrial DNA. In genomics, both coding and non-coding DNA is sequenced and analyzed. Genomics allows a better understanding of all living things, their evolution, and their diversity. It has a myriad of uses: for example, to build phylogenetic trees, to improve productivity and...
36.1K


