评估人工智能语言模型在回答妊娠相关问题时,由产科专家进行评估
Betül Keyif1, Engin Yurtçu2, Alper Başbuğ2
1Department of Obstetrics and Gynecology, Faculty of Medicine, School of Medicine, Duzce University, 81620, Konuralp, Duzce, Turkey. betulkeyif@duzce.edu.tr.
Scientific reports
|February 16, 2026
概括
在提供准确和患者友好的怀孕信息方面,ChatGPT-4.0的表现优于Gemini和ChatGPT-3.5. 专家监督对于人工智能产生的健康内容至关重要,以确保安全性和可靠性.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 产科和妇科 产科和妇科
背景情况:
- 大型语言模型 (LLM) 显示了医疗保健沟通的潜力.
- 评估LLM反应的临床准确性和患者友好性至关重要.
研究的目的:
- 为了比较ChatGPT-3.5,Gemini和ChatGPT-4.0在回答与怀孕有关的问题的性能.
- 根据专家的准确性,可靠性,患者友好性和可理解性来评估人工智能产生的反应.
主要方法:
- 75名妇产科专家使用5个点的利卡特级别对30个匿名AI反应进行了评分.
- 在所有三个LLM中都使用了标准化的零射击提示.
- 克鲁斯卡尔-瓦利斯和曼-惠特尼U测试分析了性能差异;克伦巴赫的α评估了评分器之间的一致性.
主要成果:
- 聊天GPT-4.0显示出最高的性能,特别是在准确性和患者友好性方面.
- 双子座在可理解性方面与ChatGPT-4.0相当;ChatGPT-3.5的总体得分最低.
- 在准确性,可靠性和患者友好性方面发现了显著的差异 (p < 0.001).
结论:
- 在测试的模型中,ChatGPT-4.0为常见的怀孕查询提供了最临床相关和患者友好的答案.
- 人工智能工具可以帮助患者教育,但专家验证对于准确性和安全性至关重要.
- 需要进一步研究人工智能对患者结果的现实影响.
相关概念视频
01:59CRISPR
46.4K
Genome editing technologies allow scientists to modify an organism’s DNA via the addition, removal, or rearrangement of genetic material at specific genomic locations. These types of techniques could potentially be used to cure genetic disorders such as hemophilia and sickle cell anemia. One popular and widely used DNA-editing research tool that could lead to safe and effective cures for genetic disorders is the CRISPR-Cas9 system. CRISPR-Cas9 stands for Clustered Regularly Interspaced...
46.4K
01:07Teratogenicity
4.2K
The ability of a drug to produce structural deformations and functional abnormalities in the developing embryo or the fetus is called teratogenicity, and the drug producing this effect is known as a teratogen. Teratogenic effects include stillbirth, miscarriage, intrauterine growth restriction, and neurocognitive delay. A teratogen may affect the embryo at different stages of development, which is important in determining the type and extent of the damage. During blastocyst formation, the early...
4.2K