大型语言模型输出和NHS口腔医学患者信息的比较评估
Jamila Tukur Jido1, Ahmed Al-Wizni2, Mariam Alkateb3
1Department of Geriatrics, Queen Elizabeth University Hospital, Glasgow, GBR.
Cureus
|August 18, 2025
概括
大型语言模型 (LLM) 生成的健康信息比国家卫生服务 (NHS) 材料难以阅读. 确保人工智能生成的内容符合可读性标准对于公平的患者护理至关重要.
科学领域:
- 医疗保健通讯 医疗保健通讯
- 人工智能在医学中的应用
- 患者教育 患者教育
背景情况:
- 国家卫生服务 (NHS) 长期计划促进了可访问的患者信息的数字工具.
- 人工智能产生的健康材料的可读性,特别是对于口腔医学条件的可读性,尚未得到很好的证实.
- 常见的口服药物疾病包括异口症,口腔候群病和石病.
研究的目的:
- 通过三个大型语言模型 (LLM) 生成的患者信息传单的可读性与现有的NHS英国传单进行比较.
- 评估LLM产生的内容是否适合于口腔医学中的公共卫生传播.
- 评估人工智能在可访问,以患者为中心的医疗保健沟通中的作用.
主要方法:
- 对LLM生成的患者传单进行横截面分析,这些传单涉及异口症,口腔候群病和石病.
- 将LLM输出与相同的NHS英国患者传单进行比较.
- 使用Flesch阅读易度得分 (FRES),Flesch-Kincaid等级水平 (FKGL) 和枪击雾指数评估可读性.
主要成果:
- 英国NHS的传单显示出优异的可读性 (FKGL:5.9-6.3;FRES:70.5-72.4),适合11-14岁的人.
- 在LLM中,ChatGPT输出是最易读的 (FKGL:6.8-7.2).
- 深度搜索 (FKGL: 8.3-8.7) 和双子座 (FKGL: 9.7-10.2) 产生了越来越复杂的文本,经常超过推水平.
结论:
- 虽然LLM生成的患者信息很有希望,但比专业撰写的NHS材料要难以阅读.
- 在人工智能产生的内容中读数更高的水平可能会阻碍患者的理解,并加剧健康不平等.
- 确保人工智能产生的健康材料符合可读性标准对于公平,以患者为中心的护理至关重要.
相关概念视频
Assessment of the Mouth
404
A thorough mouth assessment, including inspection and palpation of the lips, gums, tongue, tonsils, uvula, and pharynx, is crucial in detecting potential health issues. Diseases ranging from oral cancer to systemic conditions like diabetes could be identified early through careful oral examination. This article provides a detailed guide on conducting a comprehensive mouth assessment.
Mouth Inspection
The inspection begins with visually examining the mouth for symmetry, color, and size.
Mouth Inspection
The inspection begins with visually examining the mouth for symmetry, color, and size.
404
Respiratory Assessment: Purpose and Indications
1.2K
Respiratory assessment is a cornerstone of nursing assessments, crucial for the early detection of patient deterioration. This evaluation transcends routine procedures, representing a critical skill nurses must master to ensure optimal patient care.
Objectives and Importance:
The primary goal of respiratory assessment is to evaluate patients at early risk of clinical deterioration. Since respiratory distress often precedes other signs of declining health, breathing patterns and sounds become a...
Objectives and Importance:
The primary goal of respiratory assessment is to evaluate patients at early risk of clinical deterioration. Since respiratory distress often precedes other signs of declining health, breathing patterns and sounds become a...
1.2K
Assessment of Airway, Skin Color, and Use of Accessory Muscles
1.1K
A thorough assessment of respiratory health is paramount in clinical settings to identify and manage respiratory distress and ensure adequate oxygenation. This article elaborates on the critical aspects of respiratory evaluation, including airway assessment, skin color examination, and the observation of accessory muscle use, which are integral to effectively diagnosing and managing patients with respiratory conditions.
Introduction
The initial evaluation of a patient's respiratory system...
Introduction
The initial evaluation of a patient's respiratory system...
1.1K
Assessing Body Temperature - Oral
833
Here are the steps to accurately measure oral temperature using an electronic thermometer:
Step 1:
Start by practicing proper hand hygiene to prevent the spread of microorganisms.
Step 2:
Take the thermometer out of the charging unit, switch it on, and wait for the ready sign.
Step 3:
Gently slide the probe cover until a click is heard. This simple action prevents cross-contamination and ensures the correct placement of the probe cover.
Step 4:
Instruct the patient to open their mouth and place...
Step 1:
Start by practicing proper hand hygiene to prevent the spread of microorganisms.
Step 2:
Take the thermometer out of the charging unit, switch it on, and wait for the ready sign.
Step 3:
Gently slide the probe cover until a click is heard. This simple action prevents cross-contamination and ensures the correct placement of the probe cover.
Step 4:
Instruct the patient to open their mouth and place...
833
Classification of Illness
7.9K
The meaning of illness is individualized to each person who experiences an alteration in health. In contrast, disease is a medical term indicating a pathological change in the structure and function of the body or mind. It is a condition that has specific symptoms and boundaries.
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
7.9K
Health Literacy
4.1K
Health literacy is an individual's or a community's capacity to comprehend, receive, read, and use relevant healthcare information and services. The World Health Organization (WHO, 2018) defines health literacy as the cognitive and social skills that determine the ability of individuals to gain access to, understand, and use information in ways that promote and maintain good health. As a result, the WHO helps individuals manage long-term health concerns, participate in preventative...
4.1K


