对比医疗文本的少数镜头和传统命名实体识别模型
Yao Ge1, Yuting Guo1, Yuan-Chi Yang1
1Department of Biomedical Informatics School of Medicine, Emory University Atlanta, GA.
概括
少数射击学习 (FSL) 模型在医疗命名实体识别 (NER) 任务中扎,即使是小数据集. 目前的FSL和传统模型表现不佳,特别是在杂的医疗文本数据上,这表明需要进一步研究.
科学领域:
- 自然语言处理 (NLP) 是一种自然语言处理.
- 机器学习 (ML) 是指机器学习.
- 生物医学信息学 生物医学信息学
背景情况:
- 监督机器学习,特别是深度神经网络,需要大量的注释数据集,这些数据集在医学研究中往往很少 (例如,罕见疾病).
- 短暂学习 (FSL) 旨在通过有限的注释数据来应对挑战.
- 缺乏在不同训练集大小中对FSL和医疗文本命名实体识别 (NER) 传统模型的性能比较.
研究的目的:
- 通过比较多个FSL模型与医学文本NER.传统模型的性能来弥合研究差距.
- 通过使用与健康相关的NER数据集,评估不同培训集大小的模型性能.
主要方法:
- 基准测试了三种传统的NER模型 (BERT-线性分类器,BERT-CRF,SANER) 和三种FSL NER模型 (StructShot & NNShot,Few-Shot Slot Tagging,ProtoNER).
- 使用了五个与健康相关的注释NER数据集进行实验.
- 在不同训练数据量中分析模型性能.
主要成果:
- 传统和FSL模型在小型医疗数据集上表现明显低于最先进的性能,F1得分通常低于30%.
- 与非医疗文本报告的性能相比,FSL模型在医疗文本上的表现不佳.
- 在杂的医学文本来源 (如社交媒体) 上,FSL方法的表现较差,而不是更清洁的来源 (如医学文献).
结论:
- 当前最先进的FSL系统还不适合在医学NLP中有效的NER.
- 需要进一步的研究,以提高FSL模型的性能,用于医学文本分析.
- 开发专门的,标准化的数据集,反映现实世界的场景,可以在这个领域推进FSL方法.
相关概念视频
Combination Therapies and Personalized Medicine
4.9K
Combining two or more treatment methods increases the life span of cancer patients while reducing damage to vital organs or tissue from the overuse of a single treatment. Combination therapy also targets different cancer-inducing pathways, thus reducing the chances of developing resistance to treatment.
The combination of the drug acetazolamide and sulforaphane is a good example of combination therapy to treat cancer. The cells in the interior of a large tumor often die due to the hypoxic and...
The combination of the drug acetazolamide and sulforaphane is a good example of combination therapy to treat cancer. The cells in the interior of a large tumor often die due to the hypoxic and...
4.9K
Classification of Illness
7.6K
The meaning of illness is individualized to each person who experiences an alteration in health. In contrast, disease is a medical term indicating a pathological change in the structure and function of the body or mind. It is a condition that has specific symptoms and boundaries.
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
7.6K
Drug Nomenclature
1.8K
During the development of a new pharmaceutical, the manufacturer initially assigns a code name to the drug. Once approved, the drug receives a United States Adopted Name (USAN)—a generic, nonproprietary designation. Upon being listed in the United States Pharmacopeia, this nonproprietary name becomes the drug's official name. Additionally, the manufacturer assigns a proprietary name or trademark, which serves as the brand name under which the drug is marketed. It is worth noting that...
1.8K


