基于LLM的临床命名实体识别的基于跨度的注释框架:使用韩国紧急部门的笔记开发和验证
Eun Hye Jang1,2, Javier Aguirre2, Sangji Lee1,2
1Department of Digital Health, SAIHST, Sungkyunkwan University, Seoul, 06355, Korea.
JAMIA open
|December 1, 2025
概括
这项研究开发了一种基于跨度的注释框架,用于使用大型语言模型 (LLM) 进行临床命名实体识别 (NER). 精心调整的LLM超越了人类注释者,显示了自动化临床数据标签的前景.
科学领域:
- 自然语言处理自然语言处理.
- 医疗信息学 医疗信息学
- 人工智能的人工智能
背景情况:
- 临床命名实体识别 (NER) 对于从电子健康记录中提取信息至关重要.
- 大型语言模型 (LLM) 显示了改善临床NER任务的潜力.
- 开发有效的注释框架对于培养准确的临床NER模型至关重要.
研究的目的:
- 开发和验证使用LLMs的临床NER基于跨度的注释框架.
- 对基线模型和人类注释者的微调LLM的性能进行评估.
- 在现实世界临床环境中评估框架的稳定性.
主要方法:
- 构建了两个数据集,其中包含来自韩国急诊部临床笔记的单词级和短语级注释.
- 在这些数据集上微调了韩国语言特定的LLM,创建了三种变体.
- 将微调的LLM变体与少量LLM和微调的小语言模型 (SLM) 基线进行比较.
主要成果:
- 在临床NER任务中,所有三种微调的LLM变体的表现都明显优于基线模型.
- 最终的LLM变体在各种评估指标上获得了超过0.80的F1分数.
- 与人类注释者相比,微调的LLM表现出更高的性能.
结论:
- 监督微调 (SFT) 优于基于LLM的临床NER的提示工程.
- 开发的基于跨度的注释框架和微调的LLM是强大的,可以在实际环境中应用.
- 在多语言的临床数据中,LLM能够有效地处理复杂而长的实体跨度.
相关概念视频
Nursing Clinical Information System
1.2K
Nursing Clinical Information System (NCIS)
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:
1.2K
Local Anesthetics: Clinical Application as Epidural Anesthesia
672
Epidural anesthetics are administered in the fat-filled epidural space, the outermost part of the spinal canal. This technique is commonly employed for pain management and anesthesia during lower abdomen and pelvis surgeries or labor and delivery.
Since epidural anesthetics can be infused through an epidural catheter, all types of drugs, including short-acting ones, can be administered. Chloroprocaine and lidocaine are examples of short and long-duration anesthetics, respectively. Bupivacaine...
Since epidural anesthetics can be infused through an epidural catheter, all types of drugs, including short-acting ones, can be administered. Chloroprocaine and lidocaine are examples of short and long-duration anesthetics, respectively. Bupivacaine...
672
Methods of Documentation VII: EMR
1.4K
Electronic Medical Records (EMRs) primarily center around electronically documenting patients' health information within a single healthcare organization or practice. They contain essential clinical data related to a patient's medical history, diagnoses, medications, treatment plans, lab results, and other pertinent information relevant to the specific encounter or episode of care. EMRs are designed to streamline documentation and workflow processes within individual healthcare...
1.4K
Local Anesthetics: Clinical Application as Spinal Anesthesia
1.3K
Spinal anesthetics are given during lower abdomen and limb surgeries to block sensory and motor neurons. They are administered in the mid to low lumbar regions, primarily acting on the cauda equina's nerve roots. The blockade level depends on the local anesthetic (LA) concentration. Usually, low LA concentrations are sufficient to block sensory fibers, while only high LA concentrations block motor fibers. Other factors like injection volume and speed, the patient's posture, and the drug...
1.3K
ER Retrieval Pathway
4.6K
In the secretory pathway, vesicles transport proteins from one cellular compartment to another in forward transport to deliver the protein to its correct location. Occasionally, misfolded proteins and incorrect proteins escape their original compartments, and a retrieval pathway is used to return the escaped proteins to their original compartment.
The ER uses many checkpoints to prevent the entry of incorrectly folded or a resident protein as cargo onto a transport vesicle. These mechanisms...
The ER uses many checkpoints to prevent the entry of incorrectly folded or a resident protein as cargo onto a transport vesicle. These mechanisms...
4.6K
Local Anesthetics: Clinical Application as Intravenous Regional Anesthesia
1.1K
Intravenous regional anesthesia or the Bier block technique is used to anesthetize a specific limb or extremity. It uses exsanguinated or blood-drained vessels to transport local anesthetics or LAs to the peripheral nerve trunks. Lidocaine without vasoconstrictors like epinephrine is most commonly used for this technique. Other drugs used are prilocaine, ropivacaine, and chloroprocaine. Bupivacaine is not recommended for this technique due to its high cardiac toxicity.
One of the advantages of...
One of the advantages of...
1.1K


