在临床编码中适应大型语言模型用于电子医疗记录的自动总结
Bokang Bi1, Leibo Liu1, Oscar Perez-Concha1
1Centre for Big Data Research in Health, The University of New South Wales, Sydney, Australia.
Studies in health technology and informatics
|September 25, 2024
概括
在生物医学数据上训练的大型语言模型 (LLM) 的适应可以改善医疗编码人员的临床文本总结. 特定领域的LLM适应提高了电子医疗记录处理的效率.
科学领域:
- 人工智能在医学中的应用
- 临床信息学 临床信息学
- 自然语言处理自然语言处理.
背景情况:
- 临床编码依赖于总结患者的叙述,这对于人类编码人员来说是一项复杂的任务.
- 大型语言模型 (LLM) 显示了临床文本总结的潜力,特别是在域调整后.
- 现有的LLM需要调整以有效处理复杂的临床文档.
研究的目的:
- 评估临床领域适应大型语言模型 (LLM) 在总结临床文本方面的有效性.
- 为了比较在临床数据上微调后,在生物医学和一般数据集上预先训练的LLM的表现.
- 探索临床适应的LLM作为临床编码人员的辅助工具的实用性.
主要方法:
- 策划了MIMIC-III的临床文本数据集,将电子医疗记录与"简要医院课程"摘要配对.
- 精心调整了两个开源的LLM:一个是关于生物医学数据的预培训,另一个是关于一般内容.
- 对微调模型的性能与它们的基本版本进行了评估.
主要成果:
- 在生物医学数据上预先训练的LLM在临床领域适应后表现明显更好.
- 临床领域的调整增强了LLM的总结能力.
- 生物医学预训练被证明对这个临床任务比一般预训练更有益.
结论:
- 在相关领域接受过预先培训的LLM的调整为临床文本总结提供了相对于一般领域模型的优势.
- 临床适应的LLM显示出作为改善临床编码效率的辅助工具的前景.
- 进一步的研究应该调查先进的模型和更高质量的临床数据集,以提高性能.
相关概念视频
Methods of Documentation VII: EMR
825
Electronic Medical Records (EMRs) primarily center around electronically documenting patients' health information within a single healthcare organization or practice. They contain essential clinical data related to a patient's medical history, diagnoses, medications, treatment plans, lab results, and other pertinent information relevant to the specific encounter or episode of care. EMRs are designed to streamline documentation and workflow processes within individual healthcare...
825
Improving Translational Accuracy
2.5K
2.5K
Data Reporting and Recording
4.6K
Reporting and recording are crucial in data documentation. The timely, thorough, and accurate documentation of facts is essential when recording patient data. Failure to record findings during an assessment or interpretation of a problem will result in loss of information and make the patient document unreliable. The reader is left with general impressions if the information is not specific. A recording is documenting data of the individual's health information in a traceable, secure, and...
4.6K
Methods of Documentation VI: Case Management Model
561
The case management model is a multidisciplinary approach that involves healthcare professionals from diverse disciplines, such as physicians, nurses, therapists, social workers, and pharmacists, working collaboratively to address the various needs of patients. Each healthcare professional brings unique expertise and perspectives, contributing to a more comprehensive understanding of the patient's condition and tailoring treatment plans accordingly.
For example, a patient with a chronic...
For example, a patient with a chronic...
561
Guidelines for Nursing Documentation I
1.0K
Quality documentation and reporting share essential characteristics that ensure they are practical and valuable resources for those who use them. These characteristics are:
Factual:
The following points emphasize the significance of upholding accurate and unbiased documentation in healthcare.
Factual:
The following points emphasize the significance of upholding accurate and unbiased documentation in healthcare.
1.0K
Health Information Technology and Healthcare Information System
810
Health Information Technology (HIT)
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
810


