[PhenoRAG的开发和验证:基于大型语言模型和检索增强生成技术的自动化人类表型本体学术语注释的可视化工具]
Wei Zhong1, Yousheng Yan, Kai Yang
1Department of Prenatal Diagnosis, Beijing Obstetrics and Gynecology Hospital, Capital Medical University, Beijing Maternal and Child Health Care Hospital, Beijing 100026, China. yinchh@ccmu.edu.cn.
概括
PhenoRAG是一种使用大型语言模型和检索增强生成 (RAG) 的新型应用程序,自动注释临床文本中的人类表现型本体学 (HPO) 术语. 它提供了高准确度,不需要手动创建数据库,帮助罕见疾病的诊断和研究.
科学领域:
- 生物信息学和计算生物学
- 医疗信息学 医疗信息学
- 在医疗保健中的自然语言处理.
背景情况:
- 准确的注释临床文本与人类表现型本体学 (HPO) 术语对于罕见疾病诊断和研究至关重要.
- 现有的方法往往需要大量的手工策划或缺乏用户友好性.
- 大型语言模型 (LLM) 和检索增强生成 (RAG) 为自动化和准确的HPO术语注释提供了潜力.
研究的目的:
- 开发一个用户友好的可视化应用程序,PhenoRAG,用于使用LLM和RAG的自动HPO术语注释.
- 在临床病例报告的权威数据集上验证PhenoRAG的性能.
- 将PhenoRAG的性能与传统工具和其他基于RAG的应用程序进行比较.
主要方法:
- 将DeepSeek-V3 LLM与RAG技术集成,以创建一个在Streamlit.上部署的交互式Web应用程序.
- 使用了FAISS向量索引,使用BAAI/bge-small-en-v1.5句子嵌入模型和官方HPO数据集构建.
- 一个四步自动化过程:多语言翻译,表型短语提取,RAG候选人检索,术语映射和官方数据库验证.
- 验证使用来自BMJ病例报告和牛津医学病例报告的121个英语病例报告,与基线方法和ChatGPT-5相比使用性能指标 (精度,回忆,F1).
主要成果:
- PhenoRAG成功地从112个病例中生成了2,150个HPO术语,其中96.0%被官方数据库验证,幻觉率低 (1.3%),不匹配率低 (2.7%).
- 实现了63.65%的整体精度,67.34%的回忆率和65.44%的F1得分,明显优于传统的注释工具 (F1: 0.45-0.49,P < 0.001).
- 虽然F1得分低于RAG-HPO (0.78),但PhenoRAG不需要手动维护字典,并且使用值较低.
- 切换到GPT-5模型导致没有幻觉,F1得分显著增加 (P = 0.038).
结论:
- 在没有同义词数据库的情况下,PhenoRAG能够从临床文本到标准HPO术语进行高精度的自动映射.
- 该应用程序具有低使用门,免费访问和中文语言界面,适用于罕见疾病诊断和遗传咨询.
- 费诺拉格在全球范围内,特别是中国,具有显著的临床推广和多中心验证潜力.
更多相关视频
相关概念视频
Language Development
912
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
912
Retrieval
444
Retrieval is the process of getting information out of memory storage and back into conscious awareness. This ability is essential for daily tasks like brushing hair and teeth, driving to work, and performing job duties. Retrieval occurs in three ways: recall, recognition, and relearning.
Recall involves accessing information without cues, such as during an essay test, where individuals must retrieve facts and concepts from memory unaided. Another example is remembering the name of a colleague...
Recall involves accessing information without cues, such as during an essay test, where individuals must retrieve facts and concepts from memory unaided. Another example is remembering the name of a colleague...
444
Reliability and Validity
13.9K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.9K
Language
913
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
913
Genome Annotation and Assembly
21.0K
The genome refers to all of the genetic material in an organism. It can range from a few million base pairs in microbial cells to several billion base pairs in many eukaryotic organisms. Genome assembly refers to the process of taking the DNA sequencing data and putting it all back together in a correct order to create a close representation of the original genome. This is followed by the identification of functional elements on the newly assembled genome, a process called genome annotation.
21.0K
In Vitro Drug Release Testing: Overview, Development and Validation
343
In vitro dissolution and drug release tests assess how quickly and how much of a drug is released from its dosage form into an aqueous medium under standardized laboratory conditions. These tests are essential tools in pharmaceutical development and quality assurance, offering insight into the drug's performance before clinical use.During formulation development, dissolution testing identifies incomplete or inconsistent drug release issues. It also supports decisions on selecting the optimal...
343


