评估ChatGPT对基于患者的问题的答案的准确性和可重复性 眼科:一项观察性研究
Asem A Alqudah1, Abdelwahab J Aleshawi1, Mohammed Baker1
1Faculty of Medicine, Jordan University of Science and Technology (JUST), Irbid, Jordan.
Medicine
|August 9, 2024
概括
这项研究评估了ChatGPT对眼科问题的准确性. 虽然答案中等准确且可重复,但ChatGPT应该补充,而不是取代专业的医疗建议.
科学领域:
- 眼科医生 眼科 眼科
- 人工智能的人工智能
- 医疗信息学 医疗信息学
背景情况:
- 在线大型语言模型,如聊天生成预训练变压器 (ChatGPT),越来越多地用于健康信息.
- 人工智能产生的健康信息的准确性和安全性需要彻底评估.
- 眼科患者的询问是评估AI实用性的重要领域.
研究的目的:
- 评估ChatGPT对基于患者的眼科问题的答案的准确性.
- 评估ChatGPT在这个领域的答案的可复制性.
- 为了确定ChatGPT是否可以作为可靠的补充健康信息来源.
主要方法:
- 来自美国眼科学院的"问眼科医生"页面的117个患者问题被使用.
- 每个问题都通过"新聊天"功能两次输入ChatGPT.
- 答案以准确性 (全面,正确但不充分,部分正确,不正确) 和可重现性等级.
主要成果:
- 聊天GPT为59.8%的眼科问题提供了全面的答案.
- 人工智能在91.5%的评估问题中显示出可重复性.
- 准确性被发现是中等的,很大一部分答案是全面的或充足的.
结论:
- 在基于患者的眼科问题上,ChatGPT表现出中等的准确性和良好的可重现性.
- 人工智能具有作为健康信息补充工具的潜力,但不应取代专业医疗建议.
- 需要进一步的研究来调查ChatGPT在医疗保健环境中的可靠性和安全性.
相关概念视频
Blind Procedures
10.8K
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which...
10.8K
Assessment of the Gastrointestinal System II: Health Perception Pattern
637
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
637


