在临床共识和牙科植入学病例分析中各种一般大语言模型的有效性:一项比较研究
Yuepeng Wu1, Yukang Zhang2, Mei Xu3
1Center for Plastic & Reconstructive Surgery, Department of Stomatology, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China.
BMC medical informatics and decision making
|March 27, 2025
概括
在回答牙科植入物问题时,ChatGPT-4显示出最可靠的性能,性能优于Gemini Pro 1.5,Claude 3 Opus和Qwen 2.0.0. 这种评估有助于临床医生选择最佳的大型语言模型 (LLM) 以改善牙科护理.
科学领域:
- 人工智能在牙科中的应用
- 医疗信息学 医疗信息学
- 临床决策支持系统 临床决策支持系统
背景情况:
- 对牙科植入物等专业医疗领域的大型语言模型 (LLM) 的评估.
- 解决对可靠人工智能工具的需求,以支持医疗保健专业人员,特别是在服务不足的地区.
- 将领先的LLM的功能进行比较:ChatGPT-4.0,Gemini Pro 1.5(0801),Claude 3 Opus和Qwen 2.0 72B. 的功能进行比较.
研究的目的:
- 评估和比较四个著名的LLM在回答牙科植入物相关查询时的准确性和可靠性.
- 引导牙医从业人员选择最有效的临床决策和患者护理的LLM.
- 提高先进的牙科知识的可访问性,并为偏远或服务不足地区的医生提供支持.
主要方法:
- 由两名牙科植入物专家进行专家评估,他们拥有超过20年的经验.
- 将问题分类为真假,简短答案和复杂案例分析.
- 性能指标包括精度,回忆和基于贝叶斯推理的评估.
主要成果:
- 在所有问题类型中,ChatGPT-4.0显示出最一致和最稳定的表现.
- 双子Pro 1.5 ((0801) 在简单的查询中表现良好,但在复杂的案例中不太稳定.
- 对于特定场景,Qwen 2.0 72B提供了高质量的答案,但表现出了可变性;Claude 3 Opus表现出了最低的性能.
- 在评估的LLMs中,在诊断性能方面发现了显著差异,但在治疗规划方面没有.
结论:
- 聊天GPT-4.0被确定为最可靠的医疗查询的LLM,其次是Gemini Pro 1.5 ((0801).
- Qwen 2.0 72B是有前途的,但需要进一步开发以保持一致性;Claude 3 Opus目前不太适合医疗应用.
- 建议采用混合方法,结合多个LLM,以提供强大的医疗决策支持.
相关概念视频
01:27Language and Cognition
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
01:26Assessment of the Mouth
A thorough mouth assessment, including inspection and palpation of the lips, gums, tongue, tonsils, uvula, and pharynx, is crucial in detecting potential health issues. Diseases ranging from oral cancer to systemic conditions like diabetes could be identified early through careful oral examination. This article provides a detailed guide on conducting a comprehensive mouth assessment.
Mouth Inspection
The inspection begins with visually examining the mouth for symmetry, color, and size.
Mouth Inspection
The inspection begins with visually examining the mouth for symmetry, color, and size.
01:10Higher Mental Functions of the Brain: Language
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...