聊天机器人与临床医生在回答儿科牙科问题的准确性和一致性:试点研究
Rata Rokhshad1, Ping Zhang1, Hossein Mohammad-Rahimi2
1Department of Pediatric Dentistry, University of Alabama at Birmingham, Birmingham, AL, USA.
Journal of dentistry
|March 18, 2024
概括
这项试点研究发现,虽然聊天机器人可以帮助儿童牙科患者教育,但它们并不像人类牙医那样准确. 聊天机器人还没有准备好取代临床医生进行诊断.
科学领域:
- 人工智能的人工智能
- 自然语言处理自然语言处理.
- 医疗保健技术 技术 医疗保健 技术
背景情况:
- 大型语言模型 (LLM) 模拟人类类型的对话,在医疗保健领域有潜在的应用.
- 在临床环境中LLM的有效性,特别是儿科牙科,需要进行彻底的评估.
研究的目的:
- 与人类临床医生相比,评估各种公开可访问的聊天机器人的准确性和一致性,以回答儿科牙科问题的问题.
- 确定聊天机器人是否适合作为牙科专业人员的辅助或替代品.
主要方法:
- 专家们制定了30个关于儿科牙科的真假问题.
- 多个聊天机器人 (例如,ChatGPT,Bard,Claude) 和三组临床医生 (儿科牙医,普通牙医,学生) 回答了问题.
- 儿童牙科学院对答案的准确性进行了分级,使用统计分析 (ANOVA,Tukey's HSD) 和一致性检查 (Cronbach's alpha).
主要成果:
- 儿科牙医获得了最高的准确性 (96.67%),明显超过一般牙医 (88.0%),学生 (80.8%),以及所有聊天机器人 (p < 0.001).
- 在聊天机器人中,ChatGPT显示了最高的准确性 (78%).
- 大多数聊天机器人,除了ChatGPT 3.5,表现出可以接受的一致性 (Cronbach的alpha> 0.7).
结论:
- 聊天机器人显示出作为教育工具和在儿科牙科中传播患者信息的潜力.
- 目前的聊天机器人不是儿童牙科诊断决策中人类临床医生的可靠替代品.
- 需要进一步的研究来提高聊天机器人的准确性和临床应用的安全性.
相关概念视频
01:08The Availability Heuristic
6.0K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
6.0K
01:15Teeth
410
The formation of teeth, also known as odontogenesis, is a complex process that begins in utero, around the sixth week of embryonic development. There are three stages to this process: the bud stage, the cap stage, and the bell stage.
In the bud stage, the tooth germ (an aggregation of cells) starts to form in the developing jawbone. During the cap stage, the tooth germ differentiates into enamel organ, dental papilla, and dental sac, which will later develop into the tooth's enamel, dentin...
In the bud stage, the tooth germ (an aggregation of cells) starts to form in the developing jawbone. During the cap stage, the tooth germ differentiates into enamel organ, dental papilla, and dental sac, which will later develop into the tooth's enamel, dentin...
410
01:21Barriers to Effective Communication II
3.6K
The barriers to effective communication also include cultural barriers, semantic barriers, gender barriers, and time constraints.
Cultural barriers:
Differences in values, beliefs, religion, knowledge, and tradition can significantly impact communication. Awareness of nonverbal cues is critical, especially when conversing with a patient from a different culture. What appears appropriate in one culture may be inappropriate in another.
Semantic barriers:
As a result of their tendency to use...
Cultural barriers:
Differences in values, beliefs, religion, knowledge, and tradition can significantly impact communication. Awareness of nonverbal cues is critical, especially when conversing with a patient from a different culture. What appears appropriate in one culture may be inappropriate in another.
Semantic barriers:
As a result of their tendency to use...
3.6K
01:17Ethical Dilemmas I
891
Ethical dilemmas in nursing are of utmost importance, as they often arise from the tension between adhering to core ethical principles and the practical realities of healthcare delivery. These dilemmas require nurses to navigate complex situations where competing ethical considerations pull them in different directions.
Let us explore some examples to understand the potentially complex moral decisions nurses face.
Take the case of caring for minors, particularly in areas related to reproductive...
Let us explore some examples to understand the potentially complex moral decisions nurses face.
Take the case of caring for minors, particularly in areas related to reproductive...
891