相关实验视频

Updated: Jun 29, 2025

A Postoperative Evaluation Guideline for Computer-Assisted Reconstruction of the Mandible

A Postoperative Evaluation Guideline for Computer-Assisted Reconstruction of the Mandible

Published on: January 28, 2020

评估不同的人工智能聊天机器人对口腔和面外科手术中临床决策的基于案例问题的AI产生的反应

Ali Azadi¹, Fatemeh Gorjinejad², Hossein Mohammad-Rahimi³

¹Dentofacial Deformities Research Center, Research Institute for Dental Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran.

Oral surgery, oral medicine, oral pathology and oral radiology

|April 3, 2024

概括

像谷歌Bard和GPT-4这样的AI聊天机器人在回答口腔和面外科手术临床问题时显示出显著的不准确性. 这些人工智能工具对于手术决策支持还不够可靠.

科学领域:

人工智能在医学中的应用
口腔和牙面部外科手术

背景情况:

人工智能聊天机器人的快速发展为临床决策支持提供了潜在的应用.
在专业医疗领域评估人工智能产生的反应的准确性至关重要.

研究的目的:

评估谷歌Bard,GPT-3.5,GPT-4,Claude-Instant和Bing聊天机器人为口腔和面外科 (OMFS) 的临床问题提供的答案的正确性.

主要方法:

50个基于案例的问题 (多项选择和开放式) 由3位经过董事会认证的OMFS外科医生开发.
聊天机器人的答案被评估与专家选择多选题的选择.
开放式答案使用修改后的全球质量表进行评估.

主要成果:

聊天机器人的准确度在26% (Bing) 到38% (GPT-4) 之间.
在开放式问题上,GPT-4的得分最高 (四,五年级),而Bing的得分最低 (一,二年级).
对于任何一个问题类型,聊天机器人之间没有发现统计学上显著的差异 (P > .05).

结论:

当前的人工智能聊天机器人在回答OMFS临床决策问题时表现出严重的不准确性.
尽管在一些开放式问题的熟练程度,人工智能技术还不是一个值得信赖的顾问临床医生.

更多相关视频

Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization

Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization

Published on: February 23, 2024

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

相关概念视频

Ethical Dilemmas II

Ethical Dilemmas II

Resolving an ethical dilemma in healthcare involves a systematic approach that considers every aspect of the issue, respecting both the patient's needs and values and the healthcare professional's ethical obligations. Here are potential steps to resolve an ethical dilemma:

Issues And Trends In Healthcare Delivery System

Issues And Trends In Healthcare Delivery System

The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...

The Availability Heuristic

The Availability Heuristic

A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):