将ChatGPT的医疗建议进行 (图灵) 测试:调查研究研究
Oded Nov1, Nina Singh2, Devin Mann2,3
1Department of Technology Management, Tandon School of Engineering, New York University, New York, NY, United States.
JMIR medical education
|July 10, 2023
概括
在最近的一项研究中,患者无法可靠地区分人类和AI聊天机器人的反应. 虽然对健康问题的聊天机器人的信任是适度的,但随着健康复杂性的增加,它会下降.
科学领域:
- 医疗保健中的人工智能
- 人与计算机的交互
- 患者沟通 患者沟通
背景情况:
- 医疗保健中越来越多地使用聊天机器人,需要了解患者的感知和信任.
- 目前的研究还不清楚患者是否能够区分人工智能产生的反应与人类提供者的反应.
研究的目的:
- 评估使用人工智能 (AI) 聊天机器人,特别是ChatGPT,用于患者与医疗服务提供者的沟通的可行性.
- 评估患者区分人工智能产生的和人类产生的反应的能力.
- 为了测量患者对人工智能聊天机器人的信任,用于与医疗保健相关的查询.
主要方法:
- 一项涉及392名参与者的调查研究于2023年1月进行.
- 参与者审查了十个患者-提供者互动,由人类提供者或ChatGPT生成的响应.
- 参与者在财务上受到激励,以确定每个响应的来源,并在利克特级别上对人工智能聊天机器人的信任度.
主要成果:
- 参与者正确识别了65.5%的聊天机器人响应和65.1%的人类响应,表明区分能力较差.
- 患者对人工智能聊天机器人进行医疗保健沟通的信心平均为3.4分之5.
- 随着患者问题的健康相关复杂性增加,信任水平下降.
结论:
- 患者很难区分聊天GPT产生的反应和人类提供者的反应.
- 患者对人工智能聊天机器人对低风险健康查询的信任程度中等.
- 随着人工智能聊天机器人向医疗保健中的更临床角色过渡,进一步的研究至关重要.
相关概念视频
01:20Comparing the Survival Analysis of Two or More Groups
226
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
226
01:18Guidelines and Strategies for Safe Computer Charting
833
The guidelines and strategies provided by the American Nurses Association (ANA) and the Canadian Nurses Association (CNA) offer essential principles for ensuring safe and secure computer charting systems in healthcare settings. Let's break down each recommendation:
Maintain Confidentiality and Security:
Maintain Confidentiality and Security:
833
01:29Assessment of the Gastrointestinal System II: Health Perception Pattern
143
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
143