医疗实体链接使用关系诱导的密集检索
Ayush Singh1, Saranya Krishnamoorthy1, John E Ortega1
1inQbator AI, Evernorth Health Services, Saint Louis, MO USA.
Journal of healthcare informatics research
|April 29, 2024
概括
NeighBERT通过将知识图关系纳入变压器模型来增强临床文本分析. 这提高了电子健康记录上的医疗实体链接 (MEL) 和命名实体识别 (NER) 性能.
科学领域:
- 临床自然语言处理 临床自然语言处理
- 医疗保健中的人工智能
- 生物信息学是一种生物信息学.
背景情况:
- 医疗实体链接 (MEL) 对于临床NLP至关重要,但受到电子健康记录 (EHR) 中模糊文本的挑战.
- 现有的变压器模型显示出希望,但与临床语言固有的模糊性作斗争.
- 解决模两可是提高从临床笔记中提取信息准确性的关键.
研究的目的:
- 引入NeighBERT,这是一种针对变压器模型的新型预训练技术,旨在解决临床文本中的模两可.
- 为了提高医疗实体链接和命名实体识别的性能.
- 改进从电子健康记录中提取相关的医疗信息.
主要方法:
- 开发了NeighBERT,这是一个定制的预训练技术,通过从知识图中编码实体关系来扩展BERT.
- 将关系上下文集成到变压器架构中,以更好地解决文本的模两可.
- 在两个标准临床数据集上评估NeighBERT,用于命名实体识别和医疗实体链接任务.
主要成果:
- 在命名实体识别 (NER) 精度,回忆和F1得分方面,NeighBERT显著提高了1-3分.
- 医疗实体链接 (MEL) 的表现取得了实质性增长,F1得分提高了10-15分.
- 关系上下文编码有效地减少了临床文本处理中的模两可.
结论:
- NeighBERT提供了一种强大的新方法来增强基于变压器的临床NLP任务,特别是MEL和NER.
- 该方法成功地结合了关系知识,克服了标准BERT在处理模两可的临床文本方面的局限性.
- 这一进步有可能从电子健康记录中提取更准确,更可靠的信息.
相关概念视频
Retrieval
109
Retrieval is the process of getting information out of memory storage and back into conscious awareness. This ability is essential for daily tasks like brushing hair and teeth, driving to work, and performing job duties. Retrieval occurs in three ways: recall, recognition, and relearning.
Recall involves accessing information without cues, such as during an essay test, where individuals must retrieve facts and concepts from memory unaided. Another example is remembering the name of a colleague...
Recall involves accessing information without cues, such as during an essay test, where individuals must retrieve facts and concepts from memory unaided. Another example is remembering the name of a colleague...
109
Tight Junctions
5.3K
Tight junctions are molecular seals between cells that prevent the leaking of fluids, ions, and other small solutes across cavities and compartments in multicellular organisms. They are mainly composed of claudin and occludin transmembrane proteins, and other proteins such as tricellulin and JAM (junctional adhesion molecule). All these proteins are 4-pass transmembrane proteins, except JAM, which is a single-pass transmembrane protein belonging to the immunoglobulin superfamily. The...
5.3K
Storage
84
A schema is a mental framework that helps individuals organize and interpret information. Schemata, formed from previous experiences, influence how we process new information: how we encode it, the inferences we make, and how we retrieve it. For instance, a schema for what a typical classroom looks like might include desks, a teacher's desk, a whiteboard, and students in such an environment. This expectation helps us quickly understand and navigate new classrooms without needing to analyze...
84


