对母乳养支持的AI聊天机器人进行基准测试:质量,可读性和临床准确性的跨平台评估
İlke Özer Aslan1, Mustafa Törehan Aslan2
1Assisted Reproductive Technologies Unit, Acıbadem Maslak Hospital, Istanbul 34457, Türkiye.
Healthcare (Basel, Switzerland)
|July 29, 2025
概括
聊天GPT-4o Pro在为分娩后的个人提供高质量,可读性和准确的母乳养信息方面击败了Gemini 2.5 Pro和Copilot Pro. 人工智能聊天机器人有潜力,但在临床使用之前需要仔细验证.
科学领域:
- 医疗保健中的人工智能
- 孕产妇健康技术 产妇健康技术
- 临床信息系统临床信息系统
背景情况:
- 产后患者越来越多地使用基于大型语言模型 (LLM) 的聊天机器人进行母乳养指导.
- 这些AI反应的质量,可读性和临床指南的遵守程度在很大程度上是未知的.
- 这项研究解决了评估人工智能聊天机器人在孕产妇健康沟通中的表现的需要.
研究的目的:
- 为了比较来自ChatGPT-4o Pro,Gemini 2.5 Pro和Copilot Pro的响应的质量,可读性和事实准确性.
- 将人工智能生成的母乳养信息与已建立的临床指南 (WHO,ACOG,CDC,NICE) 相比进行评估.
- 评估用户体验指标,包括响应时间和内容结构.
主要方法:
- 对三个AI聊天机器人中的每一个人提出了20个常见的母乳养问题.
- 通过使用经过验证的工具评估了响应:为患者提供质量信息 (EQIP),简单测量Gobbledygook (SMOG) 和全球质量量表 (GQS).
- 事实准确性与领先的临床指南进行了比较,使用三点标题.
主要成果:
- 与Gemini 2.5 Pro和Copilot Pro (p < 0.001) 相比,ChatGPT-4o Pro在EQIP评分 (85.7%),SMOG评分 (9.78) 和GQS评分 (4.55) 中表现出更好的表现.
- 聊天GPT-4o Pro实现了95%的实际与临床指导方针一致,表现优于竞争对手.
- 虽然在统计学上显著,但响应时间和格式上的差异并不总是具有临床意义;Copilot Pro显示了更多的遗漏.
结论:
- 在评估的AI聊天机器人中,ChatGPT-4o Pro提供了最结构化,可读性和符合指南的母乳养信息.
- 存在显著的变化,人工智能聊天机器人不应该取代专业的医疗建议.
- 解决人工智能幻觉和提高透明度,准确性和多语言可靠性对于安全整合到孕产妇健康沟通至关重要.
更多相关视频
03:14Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
684
05:04A Common Marmoset Model of Mother-Infant Intervention for Breastfeeding Disorders in the Presence of Paternal Inhibition and Maternal Neglect
Published on: September 22, 2023
549
相关概念视频
Current Trends in Nursing II
1.4K
Trends in nursing are multifactorial and associated with changes in society, within the nursing profession, and in other professions. Notably, telehealth and remote nursing contribute to successful healthcare delivery for numerous patients and help reduce stress for nurses due to nursing shortages. Nurses can reach patients, monitor their conditions, and interact with them using computers, audio, visual accessories, and telephones—for example, remote patient monitoring systems. Likewise,...
1.4K
Improving Translational Accuracy
11.9K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.9K
Nursing Evaluation
3.6K
The evaluation stage signals the end of the nursing process. The nurse gathers evaluative data to assess whether or not the patient has attained the expected results. Whereas the nurse collects data in the nursing assessment to identify the patient's health concerns, the evaluation stage data determines if the indicated health issues are resolved. Evaluative data collection includes two sections: the data acquired to evaluate patient outcomes and the time criteria for data collection.
3.6K
Nursing Clinical Information System
867
Nursing Clinical Information System (NCIS)
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:
867
Quality Assurance
202
Quality assurance is the overarching term used to describe the activities employed to ensure the proper performance of a system. These activities can be classified into three categories: quality control, quality assessment, and internal corrective measures. Typically, these activities work cyclically: quality control is performed before and during the analysis, while quality assessment occurs during and after the investigation. Internal corrective measures are implemented based on the findings...
202
Non-equilibrium in the Cell
4.9K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.9K
