评估人工智能聊天机器人对移植后查询的回应
Yihua Zhan1, Xutao Chen1, Feihong Ye2
1Department of Urology, Sun Yat-sen Memorial Hospital, Guangzhou, China.
Transplantation proceedings
|January 15, 2025
概括
像ChatGPT,Claude 3.0和Gemini Pro这样的AI聊天机器人为脏移植问题提供了高质量的答案,但缺乏可行的建议,并且难以阅读. 谷歌搜索并没有超过这些人工智能工具.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 移植医学 移植医学
背景情况:
- 移植后的护理涉及复杂的患者调查.
- 患者越来越多地转向在线资源,包括AI聊天机器人,以获取健康信息.
- 评估人工智能产生的健康信息的准确性和可用性至关重要.
研究的目的:
- 评估AI聊天机器人 (ChatGPT 4.0,Claude 3.0,Gemini Pro) 和谷歌在回答常见的移植后问题方面的表现.
- 评估人工智能生成内容的响应质量,可理解性,可操作性和可读性.
- 为了比较不同的人工智能模型和传统搜索引擎对患者特定医疗查询的能力.
主要方法:
- 使用谷歌和Bing编制了一份包含127个移植后问题的综合清单.
- 人工智能聊天机器人和谷歌为这些问题提供了答案.
- 响应质量使用5分利克特度量表来评价.
- 使用患者教育材料评估工具 (PEMAT) 评估了可理解性和可操作性.
- 使用Flesch阅读易度和Flesch-Kincaid等级水平指标测量可读性.
- 在SPSS中使用Kruskal-Wallis测试进行了统计分析.
主要成果:
- 人工智能聊天机器人和谷歌提供了高质量的响应 (利克特平均分数:4/5) 和良好的理解性 (PEMAT平均分数:72.7%).
- 然而,答案显示可操作性差 (PEMAT得分中位数:20%) 和难以阅读 (Flesch阅读易度中位数:22.1;Flesch-Kincaid等级水平中位数:14.7).
- 克劳德3.0提供了最可靠的答案,而ChatGPT 4.0提供了最全面的答案.
- 在所有评估的指标上,谷歌的表现并不优于任何人工智能聊天机器人.
结论:
- 当前的人工智能聊天机器人和搜索引擎为移植后的患者提供通常准确但不易操作的信息.
- 对于一般患者群体来说,人工智能生成的响应的可读性水平往往太高了.
- 需要进一步开发,以提高人工智能产生的健康信息的可操作性和可读性,以帮助移植接受者.
相关概念视频
01:45Kidney Structure
68.7K
The kidneys are two large bean-shaped organs located in the upper abdomen. They filter the blood several times a day to remove toxins and rebalance water and electrolytes of the circulatory system via the renal veins. The kidneys receive blood directly from the heart via the renal arteries. These arteries enter the kidney at the hilum, the concave surface of the bean, where they branch and divide into smaller vessels and capillaries.
68.7K
01:27Dialysis
260
Renal failure occurs when the kidneys lose their ability to filter waste products from the blood effectively. It can be classified into two types: acute renal failure (ARF) and chronic renal failure (CRF).
Acute kidney injury develops suddenly and can be caused by pre-renal causes (e.g., hypovolemia, shock), intrinsic renal causes (e.g., acute tubular necrosis), or post-renal causes (e.g., urinary obstruction). In contrast, chronic renal failure progresses gradually over time and is often...
Acute kidney injury develops suddenly and can be caused by pre-renal causes (e.g., hypovolemia, shock), intrinsic renal causes (e.g., acute tubular necrosis), or post-renal causes (e.g., urinary obstruction). In contrast, chronic renal failure progresses gradually over time and is often...
260
01:11Renal Failure: Dose Adjustments
62
In patients with renal impairment, drugs undergo significant changes in their pharmacokinetics, which require dosage adjustments to ensure safe and effective therapy.
Reduced renal clearance and elimination rate are common outcomes of renal impairment. These alterations lead to a prolonged elimination half-life and an altered apparent volume of distribution for drugs. As a result, dosage adjustments are typically necessary to maintain optimal drug levels in the body.
However, dosage adjustments...
Reduced renal clearance and elimination rate are common outcomes of renal impairment. These alterations lead to a prolonged elimination half-life and an altered apparent volume of distribution for drugs. As a result, dosage adjustments are typically necessary to maintain optimal drug levels in the body.
However, dosage adjustments...
62
01:17Drug Elimination by Renal Route: Glomerular Filtration
5.4K
The kidney serves as the primary organ responsible for eliminating drugs and their metabolites from the body. This process, known as renal elimination, starts with glomerular filtration and results in urine formation. Each kidney houses millions of functional units called nephrons, where urine production takes place. A nephron has two main components: a renal corpuscle and a renal tubule. Drugs gain access to the kidney via the renal artery, which progressively branches off into afferent...
5.4K
01:33Hormonal Regulation
32.9K
The renin-aldosterone system is an endocrine system which guides the renal absorption of water and electrolytes, thus managing blood pressure and osmoregulation. Activation of the system begins in the kidneys with a small cluster of cells adjacent to the afferent and efferent blood vessels of the renal corpuscle. As the nephrons are filtering blood, juxtaglomerular cells monitor blood pressure. If they detect a decrease in pressure, they release the hormone renin into the bloodstream.
32.9K