聊天GPT与谷歌医疗知识获取搜索的对比比较
Noel F Ayoub1, Yu-Jin Lee1, David Grimm1
1Department of Otolaryngology-Head and Neck Surgery, Division of Head & Neck Surgery, Stanford University School of Medicine, Stanford, California, USA.
概括
与谷歌搜索相比,ChatGPT提供了更好的一般医学知识,但医疗建议较差. 医疗保健提供者必须指导患者负责任地使用生成性AI工具.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 患者教育 患者教育
背景情况:
- 生成型人工智能,如聊天生成预训练变压器 (ChatGPT),在包括医疗保健在内的各种生活方面越来越有影响力.
- 了解人工智能工具的能力对于医疗保健提供者来说至关重要,以有效指导患者.
研究的目的:
- 与谷歌搜索相比,评估ChatGPT作为医疗信息来源的准确性和实用性.
- 从患者的角度评估AI在提供一般医学知识和特定医学建议方面的表现.
主要方法:
- 一个横截面分析,比较ChatGPT和谷歌搜索,使用临床实践准则 (CPG) 简单的语言总结六个条件.
- 提出了以患者为中心的问题,评估一般知识和医疗建议 (紧急与常规).
- 两个盲目审查者使用患者教育材料评估工具 (PEMAT-P) 来评分答案,并进行额外的内容评估.
主要成果:
- 在提供医疗建议方面,谷歌搜索显著超过了ChatGPT,平均PEMAT-P得分为89.4% (SD:5.9) 和68.2% (SD:4.4) (p < .001).
- 在患者教育问题上,ChatGPT得分更高 (87%与78%,p = .012),而紧迫性对得分没有显著影响 (p = .613).
- 在来源之间观察到PEMAT-P得分的显著差异 (p < .001).
结论:
- 与谷歌搜索相比,ChatGPT在一般医学知识方面优越,但在医学建议方面却低劣.
- 医疗保健专业人员需要了解生成性AI的好处和风险,以便正确地向患者提供建议.
- 该研究强调,需要对人工智能产生的医疗信息进行仔细评估,以确保患者的安全和教育.
相关概念视频
Improving Translational Accuracy
2.6K
2.6K
Bioequivalence: Overview
1.1K
Pharmaceutical equivalents, by definition, are drug products with the same active ingredient in the same quantities, encapsulated in identical dosage forms, and intended for the same administration routes. These pharmaceutical equivalents are deemed bioequivalent if the bioavailability of the active entity in the drug preparations is similar. Moreover, pharmaceutical equivalents demonstrating bioequivalence are also regarded as therapeutically equivalent. This means that when used as directed,...
1.1K
Comparing the Survival Analysis of Two or More Groups
224
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
224
Clinical Trials: Overview
3.0K
Clinical development focuses on how the drug will interact with the human body and encompasses four key phases of clinical trials, each serving a specific purpose in assessing the safety and effectiveness of new drugs. These phases overlap and build upon one another. Phase I involves a small group of healthy volunteers (typically 20-80 individuals) or, in cases where significant toxicity is expected, patients with the targeted disease, such as cancer or AIDS. The volunteers are tested for...
3.0K
Evolutionary Relationships through Genome Comparisons
5.8K
Genome comparison is one of the excellent ways to interpret the evolutionary relationships between organisms. The basic principle of genome comparison is that if two species share a common feature, it is likely encoded by the DNA sequence conserved between both species. The advent of genome sequencing technologies in the late 20th century enabled scientists to understand the concept of conservation of domains between species and helped them to deduce evolutionary relationships across diverse...
5.8K


