人工智能聊天机器人的有效性和可靠性作为牙周内科信息的公共来源
Hossein Mohammad-Rahimi1, Seyed AmirHossein Ourang2, Mohamad Amin Pourhoseingholi3
1Topic Group Dental Diagnostics and Digital Dentistry, ITU/WHO Focus Group AI on Health, Berlin, Germany.
International endodontic journal
|December 20, 2023
概括
与谷歌Bard和Bing相比,GPT-3.5在牙周常见问题中表现出优越的有效性. 所有聊天机器人在回答牙科问题方面都表现出可接受的可靠性.
科学领域:
- 人工智能在牙科中的应用
- 在医疗保健中的自然语言处理.
- 牙周内科信息检索 牙周内科信息检索
背景情况:
- 人工智能聊天机器人的快速发展为访问牙科信息提供了机会.
- 在牙周内科等专业领域,评估人工智能产生的反应的准确性至关重要.
- 现有的研究还没有全面比较内牙科领先聊天机器人的表现.
研究的目的:
- 为了评估和对比GPT-3.5的有效性和可靠性,谷歌Bard和Bing对内牙常见问题 (FAQ) 的答案.
- 为了确定哪个人工智能聊天机器人为内牙查询提供了最可信的信息.
- 建立AI聊天机器人在专业牙科领域的性能基准.
主要方法:
- 专家内牙科医生制定了10个常见问题,通过GPT-3.5.5.生成额外的问题.
- 来自GPT-3.5,Google Bard和Bing的回复由两名经过董事会认证的内牙科医生使用修改的全球质量评分 (GQS) 进行评估.
- 使用低 (≥4) 和高 (5) 值评估有效性,并进行统计分析,包括费舍尔的精确测试和克伦巴赫的可靠性α.
主要成果:
- 在低值有效性测试中 (得分≥4),GPT-3.5 (95%),Google Bard (85%) 和Bing (75%) 没有显著差异 (p>.05).
- 然而,使用高值有效性测试 (得分5),GPT-3.5 (60%) 的表现明显优于谷歌Bard (15%) 和Bing (15%) (p=.008).
- 所有聊天机器人在回复中都表现出可接受的可靠性 (克朗巴赫α>0.7).
结论:
- 与谷歌Bard和Bing相比,GPT-3.5提供了更可靠的内牙信息.
- 人工智能聊天机器人显示出内牙信息传播的潜力,目前GPT-3.5是首选选项.
- 需要进一步的研究来完善AI在专业牙科领域的准确性.
相关概念视频
01:08The Availability Heuristic
6.0K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
6.0K
01:16Non-equilibrium in the Cell
4.4K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.4K
01:30Current Trends in Nursing II
1.2K
Trends in nursing are multifactorial and associated with changes in society, within the nursing profession, and in other professions. Notably, telehealth and remote nursing contribute to successful healthcare delivery for numerous patients and help reduce stress for nurses due to nursing shortages. Nurses can reach patients, monitor their conditions, and interact with them using computers, audio, visual accessories, and telephones—for example, remote patient monitoring systems. Likewise,...
1.2K
01:29Issues And Trends In Healthcare Delivery System
5.6K
The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
5.6K
01:21Tooth Anatomy
481
The human tooth enables us to eat a variety of foods, speak clearly, and even aid in shaping our faces. Teeth are composed of various elements that work together. Here's a detailed look at the anatomy of a human tooth.
The Crown, Neck, and Root
The visible part of the tooth is referred to as the crown. It's covered by enamel, the hardest substance in the human body. The crown is uniquely shaped for each type of tooth, allowing for different functions such as cutting, tearing, or...
The Crown, Neck, and Root
The visible part of the tooth is referred to as the crown. It's covered by enamel, the hardest substance in the human body. The crown is uniquely shaped for each type of tooth, allowing for different functions such as cutting, tearing, or...
481
01:15Teeth
433
The formation of teeth, also known as odontogenesis, is a complex process that begins in utero, around the sixth week of embryonic development. There are three stages to this process: the bud stage, the cap stage, and the bell stage.
In the bud stage, the tooth germ (an aggregation of cells) starts to form in the developing jawbone. During the cap stage, the tooth germ differentiates into enamel organ, dental papilla, and dental sac, which will later develop into the tooth's enamel, dentin...
In the bud stage, the tooth germ (an aggregation of cells) starts to form in the developing jawbone. During the cap stage, the tooth germ differentiates into enamel organ, dental papilla, and dental sac, which will later develop into the tooth's enamel, dentin...
433