评估医疗实体在医疗保健中的认可:实体模型定量研究
Shengyu Liu1, Anran Wang1, Xiaolei Xiu1
1Department of Medical Data Sharing, Institute of Medical Information & Library, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China.
JMIR medical informatics
|October 17, 2024
概括
这项研究评估了医疗文本的命名实体识别 (NER) 模型,发现生物医学文本挖掘的BERT卓越,而Gemma则显示出有前途. 模型性能受到实体短语长度和单词数量的影响.
科学领域:
- 自然语言处理自然语言处理.
- 医疗信息学 医疗信息学
- 机器学习 机器学习
背景情况:
- 命名实体识别 (NER) 模型对于提取结构化医疗信息至关重要,有助于临床决策和研究.
- 深度学习的进步,包括BERT和大型语言模型,已经改善了NER,但性能因医学术语的复杂性而异.
- 现有的研究往往忽视了特定的医疗背景挑战和词汇因素对NER准确性的影响.
研究的目的:
- 评估医疗文本分析的各种NER模型,重点关注复杂术语的准确性.
- 调查宏观因素对模型性能的影响,以改进NER模型.
- 提高NER模型在医疗应用中的可靠性.
主要方法:
- 在3个医学数据集 (JNLPBA,BioCreative V CDR,AnatEM) 上评估了7个NER模型 (包括HMM,CRF,BERT变体和Gemma).
- 评估预测准确性,资源利用率 (CPU/GPU) 和超参数调整影响.
- 使用多层次因素消除算法选影响业绩的宏观因素.
主要成果:
- 对生物医学文本挖掘进行微调的BERT在修订后的JNLPBA (0.932 AVG_MICRO) 和AnatEM (0.8494 AVG_MICRO) 上实现了最高精度.
- 低级适应的Gemma在BioCreative V CDR (0.9962 AVG_MICRO) 上领先,但在其他数据集上显示出变化.
- 实体短语长度和每个短语单词的数量被确定为影响模型性能的重要宏观因素.
结论:
- 在医疗信息学中,NER模型至关重要,需要通过精确的数据定位和微调来优化.
- 结果将改善临床决策,并指导开发更有效的医疗NER模型.
相关概念视频
01:30Health Information Technology and Healthcare Information System
806
Health Information Technology (HIT)
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
806
01:30Methods of Documentation VII: EMR
825
Electronic Medical Records (EMRs) primarily center around electronically documenting patients' health information within a single healthcare organization or practice. They contain essential clinical data related to a patient's medical history, diagnoses, medications, treatment plans, lab results, and other pertinent information relevant to the specific encounter or episode of care. EMRs are designed to streamline documentation and workflow processes within individual healthcare...
825
01:11Purpose of Health Records I
1.2K
The vital purpose of health records is to provide a complete and accurate account of a patient's medical history, including communication, diagnostic and therapeutic orders, care planning, research, and quality review.
Here's a breakdown of how health records serve these purposes:
Here's a breakdown of how health records serve these purposes:
1.2K
01:29Issues And Trends In Healthcare Delivery System
5.6K
The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
5.6K
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
123
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
123
01:29Documentation in Long-Term and Home Healthcare Setting
873
Documentation in long-term care facilities and home healthcare settings is crucial for ensuring continuous, coordinated, and comprehensive care for patients. Each setting has its specific documentation processes and tools:
Long-Term Care Facilities
Long-Term Care Facilities
873