使用大型语言模型提高在线患者教育材料的可读性:跨部分研究
John Will1, Mahin Gupta1, Jonah Zaretsky2
1Medical Center Information Technology Department of Health Informatics, New York University Langone Health, New York, NY, United States.
Journal of medical Internet research
|June 4, 2025
概括
大型语言模型 (LLM) 可以将患者教育材料 (PEM) 简化到六年级的阅读水平,提高可访问性. 虽然一般准确和易于理解,但由于一些LLM输出中的轻微不准确性,人类审查至关重要.
科学领域:
- 医疗信息学 医疗信息学
- 在医疗保健中的自然语言处理.
- 患者教育 患者教育
背景情况:
- 患者教育材料 (PEMs) 对于患者赋权至关重要,但通常写在六年级阅读水平以上.
- 这种不可访问性限制了患者群体中很大一部分的理解.
- 大型语言模型 (LLM) 为简化复杂的医疗信息提供了一个潜在的解决方案.
研究的目的:
- 评估三个LLM (ChatGPT,Gemini,Claude) 在优化在线PEM可读性的有效性.
- 评估LLM简化是否会损害教育内容的准确性和易理解性.
- 为了确定LLMs是否可以将PEM降低到六年级推的阅读水平.
主要方法:
- 一项横截面研究分析了来自三个健康网站的60个随机选择的在线PEM.
- 要求LLM简化选定的PEM的阅读水平.
- 使用Flesch阅读易度,Flesch-Kincaid等级水平,枪击雾指数和简单测量Gobbledygook (SMOG) 指数来评估可读性. 准确性和可理解性 (PEMAT-U) 也被评估.
主要成果:
- 原始PEM的平均分数高于六年级推的平均分数 (AHA: 10.7,ACS: 10.0,ASA: 9.6).
- 简化LLM显著提高了所有网站的可读性 (ChatGPT到7.6,Gemini到6.6,Claude到5.6,P<.001).
- 字数减少,基本可理解性保持;然而,Gemini和Claude输出中的3.3%含有不准确性.
结论:
- 在线患者教育课程具有显著的潜力,可以提高在线患者教育材料的可读性和可访问性.
- 保持准确性和可理解性是可以实现的,但模型性能各不相同.
- 人类监督对于在患者传播之前审查LLM生成的内容以查看任何不准确性至关重要.
更多相关视频
06:28E-Patient Counseling Trial E-PACO: Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
Published on: August 1, 2019
8.4K
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
595
相关概念视频
Health Literacy
4.2K
Health literacy is an individual's or a community's capacity to comprehend, receive, read, and use relevant healthcare information and services. The World Health Organization (WHO, 2018) defines health literacy as the cognitive and social skills that determine the ability of individuals to gain access to, understand, and use information in ways that promote and maintain good health. As a result, the WHO helps individuals manage long-term health concerns, participate in preventative...
4.2K
Genetic Lingo
105.1K
Overview
105.1K
Improving Translational Accuracy
2.7K
2.7K
Patient-centered Care
2.3K
Patient-centered care involves delivering care beyond inpatient hospitalization. Reflective practice can enhance a patient-centered approach. Reflective practice is a process of reasoning that considers all aspects of the present situation, including practicalities, learning from personal practice, and consideration of patient needs. Patients appreciate care decisions made while considering their input. Involving the patient in their care provides the patient with a sense of contribution rather...
2.3K
Documentation in Long-Term and Home Healthcare Setting
994
Documentation in long-term care facilities and home healthcare settings is crucial for ensuring continuous, coordinated, and comprehensive care for patients. Each setting has its specific documentation processes and tools:
Long-Term Care Facilities
Long-Term Care Facilities
994
