在牙科中评估人工智能产生的反应的准确性,完整性和可靠性:评估ChatGPT模型的试点研究
Kelly F Molena1, Ana P Macedo2, Anum Ijaz3
1Department of Pediatric Dentistry, School of Dentistry of Ribeirão Preto at University of São Paulo, Ribeirão Preto, BRA.
Cureus
|August 29, 2024
概括
牙科领域的人工智能 (AI) 是有前途的,ChatGPT在重新评估后显示出更高的准确性和完整性. 然而,对于复杂的案件和基于证据的实践,人类监督仍然至关重要.
科学领域:
- 牙科 牙科是指牙科的专业.
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 人工智能 (AI) 越来越多地被讨论为牙科知识获取和诊断的工具.
- 它在临床决策中的应用引发了关于可靠性和准确性的重要问题.
研究的目的:
- 评估牙科中ChatGPT 3.5响应的准确性,完整性和可靠性.
- 为了比较专家提出的问题和人工智能生成的答案.
主要方法:
- 牙科专家在六个专业领域创建了30个问题,答案和参考文献.
- 答案被评估使用利克尔特比例表达同意的程度.
- 统计分析比较了描述性和二进制问题,对准确性较低的答案进行了重新评估.
主要成果:
- 聊天GPT最初显示出良好的准确性和完整性,在重新评估后显著改善 (p=0.042准确性,p=0.011完整性).
- 描述性和二进制问题格式之间没有发现显著差异.
- 聊天GPT提供的引用经常是不准确的.
结论:
- 聊天GPT在牙科中显示出潜力,但需要进一步改进.
- 通过机器学习的持续改进是显而易见的,但不准确性仍然存在.
- 人类的批判性判断对于复杂的临床场景和推进基于证据的牙科是不可或缺的.
相关概念视频
01:16Non-equilibrium in the Cell
4.3K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.3K
01:08The Availability Heuristic
5.9K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
5.9K