通过网络搜索分析评估ChatGPT在医学指南中的实用性
Jeremy A Dubin1, Sandeep S Bains1, Daniel Hameed1
1LifeBridge Health, Sinai Hospital of Baltimore, Rubin Institute for Advanced Orthopedics, Baltimore, MD, USA.
The Permanente journal
|April 26, 2024
概括
聊天GPT和谷歌搜索为健康问题提供了不同的答案. 患者和医生应该仔细评估人工智能产生的健康信息,并咨询专业人员,以获得准确的医疗指导.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
背景情况:
- 机器学习 (ML) 越来越多地用于医疗保健,影响预后模型和模式检测.
- 聊天生成预训练变压器 (ChatGPT) 是一个先进的机器学习模型,可以生成类似人类的文本.
- 评估像ChatGPT这样的AI工具对患者询问至关重要.
研究的目的:
- 为了比较ChatGPT和谷歌搜索在解决患者健康问题的能力.
- 分析两个平台提供的问题和答案的性质和来源.
- 评估人工智能生成的健康信息的可靠性.
主要方法:
- 利用美国家庭医生学会临床指南中的25个搜索术语.
- 提示聊天GPT找到与每个搜索术语相关的顶级问题.
- 从ChatGPT和谷歌搜索中比较问题和答案,并指出源域和数值答案.
主要成果:
- 42%的问题在ChatGPT和谷歌搜索之间一致.
- 与谷歌搜索相比,ChatGPT更多来自学术 (38%) 和政府 (50%) 域名 (15%的学术,39%的政府).
- 谷歌搜索使用的商业来源更多 (32%),而不是ChatGPT (11%). 39%的问题有不同的答案,其中16个ChatGPT的答案建议专业咨询,而不是数字数据.
结论:
- 聊天GPT和谷歌搜索对健康问题产生不同的问题和答案.
- 建议患者和使用ChatGPT作为健康顾问的医生谨慎使用.
- 医疗专业人员应指导患者在线讨论健康信息和询问.
相关概念视频
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
125
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
125
01:16Clinical Trials
6.7K
Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
There are four phases in a clinical trial. A phase one...
6.7K
01:12Hazard Ratio
115
The hazard ratio (HR) is a widely used measure in clinical trials to compare the risk of events, such as death or disease recurrence, between two groups over time. It reflects the ratio of hazard rates—the instantaneous risk of the event occurring—between a treatment group and a control group. This measure provides valuable insights into the relative effectiveness of a treatment by assessing how the risk of an event differs between the two groups.
For example, in a clinical trial...
For example, in a clinical trial...
115