在提供营养建议时,不同AI聊天机器人的准确性,完整性,可重现性和一致性的比较:一项探索性研究
Valentina Ponzo1, Rosalba Rosato2, Maria Carmine Scigliano3
1Department of Medical Science, University of Turin, 10126 Torino, Italy.
Journal of clinical medicine
|January 8, 2025
概括
人工智能 (AI) 聊天机器人为肥胖患者提供不准确和不一致的营养建议,特别是那些患有并发症的患者. 这些人工智能工具不能替代专家营养师提供复杂的健康指导.
科学领域:
- 人工智能的人工智能
- 营养科学 营养科学
- 医疗保健技术 技术 医疗保健 技术
背景情况:
- 越来越多的公众依赖人工智能聊天机器人来获得医疗保健信息.
- 需要评估AI在提供专业医疗咨询方面的表现.
研究的目的:
- 评估通用AI聊天机器人的准确性,完整性和可重复性,以获得营养建议.
- 在两个不同的患者病例中评估AI性能:没有并发症的肥胖症和具有多种并发症的肥胖症.
主要方法:
- 十个人工智能聊天机器人在三天内查询了两个患者病例研究.
- 三名注册营养师评估了答案的准确性,完整性和可重复性.
- 营养成分的一致性与饮食师计算进行了交叉引用.
主要成果:
- 人工智能聊天机器人表现出有限的准确性和完整性,特别是在复杂的情况下 (案例2).
- 在聊天机器人中,可复制性差异很大,有些机器人表现出很高的一致性,而另一些机器人表现出很低的一致性.
- 在蛋白质建议中发现了重大不一致性,并提供了相互矛盾的建议.
结论:
- 一般用途的人工智能聊天机器人在为肥胖和并发症患者提供可靠的营养建议方面存在重大局限性.
- 当前的人工智能聊天机器人不适合替代临床环境中的专家营养师.
- 需要进一步开发,以提高AI在专业医疗保健咨询中的准确性和可靠性.
相关概念视频
Data Validation
4.9K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
4.9K
Current Trends in Nursing II
1.2K
Trends in nursing are multifactorial and associated with changes in society, within the nursing profession, and in other professions. Notably, telehealth and remote nursing contribute to successful healthcare delivery for numerous patients and help reduce stress for nurses due to nursing shortages. Nurses can reach patients, monitor their conditions, and interact with them using computers, audio, visual accessories, and telephones—for example, remote patient monitoring systems. Likewise,...
1.2K
Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Accuracy and Precision
8.7K
Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value. Highly accurate...
8.7K
Improving Translational Accuracy
2.5K
2.5K
Confirmation Biases
5.4K
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
5.4K


