从人工智能聊天机器人对心脏导管治疗患者教育材料的可读性进行评估:一项观测性横截面研究
Benjamin J Behers1, Ian A Vargas1, Brett M Behers2
1Department of Internal Medicine, Sarasota Memorial Hospital, Sarasota, USA.
Cureus
|August 5, 2024
概括
人工智能 (AI) 聊天机器人提供心脏导管治疗的医疗信息,但阅读水平远远超过推的六年级. 聊天机器人之间的可读性差异很大,Meta AI是最容易访问的,ChatGPT是最难访问的.
科学领域:
- 医疗保健中的人工智能
- 自然语言处理自然语言处理.
- 医疗信息传播 医疗信息传播
背景情况:
- 像ChatGPT这样的大型语言模型 (LLM) 驱动的聊天机器人越来越多地用于医疗查询.
- 患者教育材料需要易于理解的语言才能有效理解.
- 评估AI聊天机器人对医学主题的可读性对于患者的理解至关重要.
研究的目的:
- 评估人工智能聊天机器人产生的心脏导管治疗患者教育内容的可读性.
- 为了比较四个领先的聊天机器人的可读性得分:ChatGPT,微软Copilot,谷歌Gemini和Meta AI.
- 确定人工智能生成的医疗信息是否符合患者推的可读性标准.
主要方法:
- 从现有的患者教育材料中开发了10个关于心脏导管的问题.
- 查询了ChatGPT,微软Copilot,谷歌Gemini和MetaAI的相同问题.
- 使用弗莱什阅读易度得分 (FRES) 和六个年级级别指数 (FKGL,GFI,CLI,SMOG,ARI,FORCAST) 评估可读性.
主要成果:
- 聊天机器人的平均Flesch阅读易度得分 (FRES) 为40.2,表明难以阅读.
- 平均成绩水平在六个不同的可读性指数中从11.2到13.7不等.
- 超级人工智能 (Meta AI) 显示阅读等级水平最低 (最容易获得) (9.6),而ChatGPT的阅读等级最高 (14.8).
结论:
- 人工智能聊天机器人可以回答医疗问题,但通常会在高中或大学阅读水平上制作内容.
- 目前用于心脏导管的AI聊天机器人输出超过了为患者教育推的六年级阅读水平.
- 聊天机器人可读性存在显著的变化,突出了需要仔细选择和潜在的AI产生的医疗内容的精细化.
相关概念视频
Health Literacy
4.0K
Health literacy is an individual's or a community's capacity to comprehend, receive, read, and use relevant healthcare information and services. The World Health Organization (WHO, 2018) defines health literacy as the cognitive and social skills that determine the ability of individuals to gain access to, understand, and use information in ways that promote and maintain good health. As a result, the WHO helps individuals manage long-term health concerns, participate in preventative...
4.0K
Heart Failure Drugs: Inotropic Agents
548
Positive inotropic agents are commonly used as the first line of treatment for heart failure. One such agent is digoxin, derived from the genus Digitalis, which has been known for centuries but effectively utilized since 1785. However, these cardiac glycosides can have potentially toxic effects due to their mechanism of action, which involves inhibiting Na+/K+-ATPase and increasing contractility. Digoxin is absorbed orally and distributed in various tissues, including the CNS. It has a long...
548
Heart Failure Drugs: β-Blockers
326
β-adrenergic antagonists, commonly known as β-blockers, block the effects of sympathetic neurotransmitters such as noradrenaline (NA) and adrenaline (ADR). They have several beneficial effects in heart failure treatment. They reduce heart rate, the force of contraction, and cardiac muscle relaxation. They also slow the atrial-ventricular conduction rate and raise the threshold for arrhythmias. The concentration of β-blockers determines their effects on bronchodilation,...
326
Non-equilibrium in the Cell
4.4K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.4K
Cardiovascular Drugs: Classification based on Therapeutic Indications
2.1K
Cardiovascular diseases, encompassing a range of conditions, can significantly affect the heart's operations and the overall circulatory system. These conditions impair the heart's ability to pump blood, leading to a deficit in oxygen supply to crucial organs. Anomalies in the heart's electrical system, known as arrhythmias, can cause heartbeats to accelerate or slow down. Usually, heart rates increase during physical activity and decrease while resting or sleeping. However,...
2.1K
Ischemic Heart Disease: Overview
1.2K
Ischemic heart disease occurs when the heart's blood supply dwindles, causing an ominous lack of oxygen and nutrients. This deficiency, stemming from reduced or obstructed blood flow, spells danger, leading to heart muscle damage and dysfunction.
Atherosclerosis, the primary malefactor, orchestrates this dangerous condition. It manifests as the accumulation of fatty deposits, akin to insidious plaques, within arterial walls. As time elapses, these plaques metamorphose, hardening and...
Atherosclerosis, the primary malefactor, orchestrates this dangerous condition. It manifests as the accumulation of fatty deposits, akin to insidious plaques, within arterial walls. As time elapses, these plaques metamorphose, hardening and...
1.2K


