"聊天GPT可以回答患者的问题吗? ": 一个初步分析.
Donghua Tao1, Karl M Kochendorfer2, Tina Griffin1
1Library of the Health Sciences, University of Illinois Chicago, Chicago IL, US.
Studies in health technology and informatics
|August 8, 2025
概括
聊天GPT-4.0在回答公共医疗问题方面表现出强的表现,在科学准确性和全面性方面获得了高分. 然而,用户应该始终与医疗保健提供者核实信息,以获得个性化的指导.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 消费者健康信息消费者健康信息
背景情况:
- 通过像ChatGPT这样的AI工具,公众对健康信息的访问正在增加.
- 对非专家来说,评估人工智能产生的医疗答案的准确性和可靠性是一个重大挑战.
- 对于一般公众而言,ChatGPT的医疗建议的可靠性在很大程度上仍未得到评估.
研究的目的:
- 评估ChatGPT-4.0对来自公众的医学问题的答案的科学准确性和全面性.
- 通过使用消费者生成的健康查询数据集,评估GPT-4.0 (ChatGPT-4.0) 的性能.
- 为非专家提供AI驱动的医疗信息质量的洞察力.
主要方法:
- 利用了来自NIH遗传和罕见疾病信息中心 (GARD) 的消费者健康问题的现有数据集.
- 使用GPT-4-0613 API生成了1467个问题答案对.
- 随机选择100对对,根据科学准确性和全面性使用0-5级别进行评估.
主要成果:
- 聊天GPT-4.0获得了很高的分数,大约90%的答案在科学准确性方面获得了4或5分,在全面性方面获得了84%的分数.
- 大约7%和14%的答案分别获得了科学准确性和全面性平均得分3分.
- 根据问题是否遵循特定框架,没有观察到答案质量的显著差异.
结论:
- 聊天GPT-4.0在回答公共医疗查询时表现出高水平的准确性和全面性.
- 尽管表现强,但该研究强调医疗保健消费者需要咨询医疗保健提供者进行验证和个性化建议.
- 建议进行进一步的研究,以探索问题措辞的影响和消费者与专业人士的比较评估.
更多相关视频
相关概念视频
Techniques of Therapeutic Communication II: Focusing, Paraphrasing, and Summarizing
9.1K
Focusing involves centering a conversation on a message's critical elements or concepts. Focusing is valuable if the talk is vague or patients begin to repeat themselves. Sometimes, when patients are asked about their symptoms, they may go off-topic and try to tell their entire life story. Respectfully, the nurse should bring the conversation back into focus.
This therapeutic technique can also be used when a patient brings up pertinent information during a health-related conversation. The...
This therapeutic technique can also be used when a patient brings up pertinent information during a health-related conversation. The...
9.1K
Assessment of the Gastrointestinal System I: Subjective Data
280
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
280
Patient-centered Care
2.3K
Patient-centered care involves delivering care beyond inpatient hospitalization. Reflective practice can enhance a patient-centered approach. Reflective practice is a process of reasoning that considers all aspects of the present situation, including practicalities, learning from personal practice, and consideration of patient needs. Patients appreciate care decisions made while considering their input. Involving the patient in their care provides the patient with a sense of contribution rather...
2.3K
Assessment of the Gastrointestinal System II: Health Perception Pattern
162
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
162
SBAR II: Application of SBAR
4.8K
SBAR is an effective communication tool used by healthcare professionals to communicate patient information accurately. SBAR stands for Situation, Background, Assessment, and Recommendation. For a better understanding, an example is given below.
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
4.8K
Barriers to Effective Communication II
3.8K
The barriers to effective communication also include cultural barriers, semantic barriers, gender barriers, and time constraints.
Cultural barriers:
Differences in values, beliefs, religion, knowledge, and tradition can significantly impact communication. Awareness of nonverbal cues is critical, especially when conversing with a patient from a different culture. What appears appropriate in one culture may be inappropriate in another.
Semantic barriers:
As a result of their tendency to use...
Cultural barriers:
Differences in values, beliefs, religion, knowledge, and tradition can significantly impact communication. Awareness of nonverbal cues is critical, especially when conversing with a patient from a different culture. What appears appropriate in one culture may be inappropriate in another.
Semantic barriers:
As a result of their tendency to use...
3.8K


