在临床自然语言处理中利用大型语言模型进行无知识的弱监督
Enshuo Hsu1,2,3, Kirk Roberts4
1McWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX, USA.
Scientific reports
|March 11, 2025
概括
这项研究引入了一种新的临床自然语言处理方法,使用大语言模型 (LLM) 来生成弱标记的数据,以最小的黄金标准数据显著提高性能.
科学领域:
- 自然语言处理自然语言处理.
- 医疗保健中的机器学习
- 临床数据分析 临床数据分析
背景情况:
- 临床NLP的深度学习需要广泛的标记数据,这是稀缺和昂贵的.
- 目前的方法,如弱监督和在文本学习与LLMs显示承诺,但落后于监督的方法.
- 士学位推断在计算上是密集的,这对广泛的临床采用构成了障碍.
研究的目的:
- 开发一种高效和有效的临床命名实体识别 (NER) 方法,使用LLM和弱监督.
- 减少对大量黄金标准临床数据的依赖.
- 为了实现与现有方法相比更高的性能,即使有有限的标记数据.
主要方法:
- 利用微调的LLM (Llama2-13B) 通过基于提示的方法生成弱标记的数据.
- 训练一个下游的BERT模型,使用这些标记较弱的数据.
- 进一步对BERT模型进行微调,对一小组黄金标准临床笔记进行微调.
- 评估三个i2b2/n2c2临床NER数据集的方法.
主要成果:
- 在三个临床NER任务中,提出的监督较弱的BERT模型始终优于开箱式PubMedBERT.
- 在F1分数中,性能收益从4.7%到47.9%不等,只有10张黄金标准纸币.
- 凭借50张黄金标准纸币,这些模型的性能与完全监督系统相提并论.
结论:
- 微调弱监督的LLM为临床NLP数据稀缺提供了强大的解决方案.
- 这种方法显著提高了临床NER的BERT模型的性能.
- 这种方法证明了一条通往更容易获得和高性能临床NLP工具的可行途径.
更多相关视频
相关概念视频
Language and Cognition
308
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
308
Nursing Clinical Information System
744
Nursing Clinical Information System (NCIS)
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:
744
Language Development
299
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
299
Methods of Documentation VI: Case Management Model
557
The case management model is a multidisciplinary approach that involves healthcare professionals from diverse disciplines, such as physicians, nurses, therapists, social workers, and pharmacists, working collaboratively to address the various needs of patients. Each healthcare professional brings unique expertise and perspectives, contributing to a more comprehensive understanding of the patient's condition and tailoring treatment plans accordingly.
For example, a patient with a chronic...
For example, a patient with a chronic...
557
Purposive Learning
96
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
96


