用微调的大型语言模型对电子健康记录中修改的兰金尺度进行评估
Luis Silva1,2, Marcus Milani2, Sohum Bindra2
1University of Florida, 1600 SW Archer Road, Gainesville, US.
JMIR AI
|January 20, 2026
概括
大型语言模型 (LLM) 可以准确地分类从电子健康记录 (EHR) 修改的兰金尺度 (mRS) 的得分,用于中风研究. 虽然对二进制结果有效,但对于中间的mRS分数需要进一步改进.
科学领域:
- 神经学 神经学
- 医疗信息学 医疗信息学
- 人工智能的人工智能
背景情况:
- 修改后的兰金尺度 (mRS) 对中风研究结果至关重要.
- 从电子健康记录 (EHR) 进行追溯的mRS评估是劳动密集型和可变的.
- 大型语言模型 (LLM) 显示出对自动化文本分类任务的前景.
研究的目的:
- 开发和评估一个微调的LLM用于从EHR文本分类mRS分数.
- 为了实现临床和研究应用的高效和可靠的mRS评分.
主要方法:
- 对中风患者的回顾性队列研究 (2020年8月 - 2023年6月).
- 两位独立研究人员在出院时和出院后90天分配了mRS分数.
- 在EHR数据上接受过多类 (7分) 和二元 (独立与非独立) LLM 的培训.
- 评估模型使用准确性和科恩的卡帕与四倍交叉验证.
主要成果:
- 在培训中使用了2,290个带有mRS分数的EHR段落.
- 多类模型实现了77%的准确性和0.92科恩的卡帕.
- 二进制模型实现了92%的准确性和0.84科恩的卡帕.
- 对于mRS 4 (90%),精度最高,对于mRS 2 (28%),精度最低.
结论:
- 可以成功培训LLM来从EHR文本中确定mRS分数.
- 开发的LLM证明了功能独立的二进制分类的高准确性.
- 需要进一步改进,以加强中间mRS分数之间的歧视.
相关概念视频
Purpose of Health Records I
1.7K
The vital purpose of health records is to provide a complete and accurate account of a patient's medical history, including communication, diagnostic and therapeutic orders, care planning, research, and quality review.
Here's a breakdown of how health records serve these purposes:
Here's a breakdown of how health records serve these purposes:
1.7K
Purpose of Health Records II
1.4K
Health records serve various essential purposes in the healthcare system. Here are some key purposes:
1.4K
Electron Orbital Model
71.8K
Orbitals are the areas outside of the atomic nucleus where electrons are most likely to reside. They are characterized by different energy levels, shapes, and three-dimensional orientations. The location of electrons is described most generally by a shell or principal energy level, then by a subshell within each shell, and finally, by individual orbitals found within the subshells.
The first shell is closest to the nucleus, and it has only one subshell with a single spherical orbital called the...
The first shell is closest to the nucleus, and it has only one subshell with a single spherical orbital called the...
71.8K
Language
892
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
892
Assessment of the Gastrointestinal System II: Health Perception Pattern
461
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
461
Nursing Assessment of the Genitourinary System I: Health History
384
The genitourinary system is critical to maintaining fluid balance, waste elimination, and reproductive function. Nurses play a vital role in assessing this system, beginning with a thorough health history. This process involves gathering patient information, identifying risk factors, and recognizing symptoms of genitourinary disorders. Early detection is vital for timely interventions and management.1. Gathering Patient InformationA complete health history includes the patient’s personal,...
384


