聊天GPT关于临床决策问题的答案:准确性和完整性的初步分析
Vijayachandra Ramachandra1, Cody W Dew2, Dawna Duff2
1Department of Communication Sciences and Disorders, Marywood University, Scranton, PA.
American journal of speech-language pathology
|August 8, 2025
概括
聊天GPT可以在沟通科学和障碍 (CSD) 中提供快速答案,但专家发现超过一半的答案不是完全准确或全面的. 临床医生不应该依靠它来做复杂的临床决策.
科学领域:
- 医疗保健中的人工智能
- 自然语言处理应用程序
- 通信科学和疾病 (CSD) 研究研究
背景情况:
- 像ChatGPT这样的人工智能 (AI) 工具的整合到学术和临床环境中正在迅速增加.
- 评估人工智能生成的信息的可靠性对于保持科学严谨性和患者安全至关重要.
- 通信科学和障碍 (CSD) 研究人员和临床医生需要了解AI在他们的领域的能力和局限性.
研究的目的:
- 评估使用ChatGPT-3.5 (免费版本) 在通信科学和障碍 (CSD) 中获取信息的优缺点.
- 评估ChatGPT对专家研究人员提出的CSD相关查询的答案的准确性和完整性.
主要方法:
- 九名大学的CSD研究人员制定了不同复杂性的问题 (基本,高级,基于证据的实践[EBP],一般的CSD).
- 查询了ChatGPT-3.5,研究人员对其准确性 (六分利克特尺度) 和完整性 (三分利克特尺度) 进行了评分.
- 总共分析了162个问题,以确定绩效指标.
主要成果:
- 在所有问题中,ChatGPT的平均准确度为5 (几乎所有问题都是正确的),平均完整度为3 (全面的).
- 对一般证券交易所问题的答案获得的综合评级明显高于基本,高级或EBP问题.
- 超过50%的答案没有被评为完全准确 (评分为6),只有54.32%被评为全面 (评分为3).
结论:
- 聊天GPT可以快速生成专家经常认为准确的响应,为信息收集提供潜在的好处.
- 然而,人工智能的答案并不总是准确或完整的,这对临床决策构成风险,特别是对于复杂的查询.
- 缺乏经验的临床医生和学生可能特别容易受到人工智能产生的不准确性影响,这凸显了对批判性评估的需要.
更多相关视频
05:04Author Spotlight: Evaluating Clinicians' Adoption of Ultrasound-Guided Vascular Cannulation Through Simulation Training
Published on: August 9, 2024
1.1K
13:44Project-Based Learning Guidelines for Health Sciences Students: An Analysis with Data Mining and Qualitative Techniques
Published on: December 9, 2022
3.7K
相关概念视频
Critical Thinking II
3.1K
Critical thinking is a cognitive process with several attributes. The attributes of critical thinking include the following:
3.1K
Decision Making: P-value Method
5.7K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.7K
Patient-centered Care
2.3K
Patient-centered care involves delivering care beyond inpatient hospitalization. Reflective practice can enhance a patient-centered approach. Reflective practice is a process of reasoning that considers all aspects of the present situation, including practicalities, learning from personal practice, and consideration of patient needs. Patients appreciate care decisions made while considering their input. Involving the patient in their care provides the patient with a sense of contribution rather...
2.3K
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
174
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
174
Methods of Documentation III: PIE
1.5K
Problem-intervention-evaluation (PIE) is a systematic approach to documentation used in healthcare settings for clinical decision-making and patient care planning. It is a structured approach to organizing patient data based on problems, interventions, and evaluations. Here's a breakdown of its key features and considerations:
1.5K
Clinical Trials
8.3K
Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
There are four phases in a clinical trial. A phase one...
8.3K
