评估人工智能聊天机器人的有效性和一致性,以回应患者在假牙方面的常见问题
Maryam Gheisarifar1, Marwa Shembesh1, Merve Koseoglu2
1Clinical Assistant Professor, Department of Restorative Dentistry, College of Dentistry, University of Illinois Chicago, Chicago, Ill.
The Journal of prosthetic dentistry
|April 8, 2025
概括
人工智能聊天机器人努力为牙套常见问题提供准确和一致的答案,显示患者信息的有效性和可靠性的局限性. 安全的医疗保健应用需要进一步开发.
科学领域:
- 人工智能在牙科中的应用
- 数字卫生技术数字卫生技术
- 假牙信息传播 假牙信息传播
背景情况:
- 人工智能 (AI) 聊天机器人在医疗保健中提出了潜在的挑战,包括不准确性,偏见和道德问题.
- 确保人工智能生成的健康信息的可靠性对于患者的安全和信任至关重要.
研究的目的:
- 评估和比较来自四个AI聊天机器人系统的响应的有效性和一致性.
- 评估聊天机器人的表现,以了解牙套领域常见问题 (FAQ).
主要方法:
- 评估了四个假牙领域 (植入物,固定的,完整的假牙,可拆卸的部分假牙).
- 对于每个领域,使用了十个由教师生成的常见问题和十个由GPT-3.5生成的常见问题.
- 从GPT-3.5,GPT-4,Gemini和Bing的答案的有效性和一致性使用统计测试 (奇平方,克伦巴赫α) 进行了评估.
主要成果:
- 聊天机器人回复显示了统计学上显著的有效性差异,特别是对于植入物和RPD常见问题,Bing通常得分最低.
- 所有聊天机器人在高值时表现出较低的有效性,而低值时则表现出较低的有效性.
- 宾,双子和GPT-4显示出可以接受的一致性,而GPT-3.5则没有.
结论:
- 当前的人工智能聊天机器人在为牙套常见问题提供高度有效和一致的答案方面存在局限性.
- 这些发现强调了在广泛采用人工智能聊天机器人的临床应用之前,需要谨慎和进一步研究,以获得患者假牙信息.
相关概念视频
01:03Data Validation
4.8K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
4.8K
01:30Current Trends in Nursing II
1.2K
Trends in nursing are multifactorial and associated with changes in society, within the nursing profession, and in other professions. Notably, telehealth and remote nursing contribute to successful healthcare delivery for numerous patients and help reduce stress for nurses due to nursing shortages. Nurses can reach patients, monitor their conditions, and interact with them using computers, audio, visual accessories, and telephones—for example, remote patient monitoring systems. Likewise,...
1.2K
01:21Barriers to Effective Communication II
3.6K
The barriers to effective communication also include cultural barriers, semantic barriers, gender barriers, and time constraints.
Cultural barriers:
Differences in values, beliefs, religion, knowledge, and tradition can significantly impact communication. Awareness of nonverbal cues is critical, especially when conversing with a patient from a different culture. What appears appropriate in one culture may be inappropriate in another.
Semantic barriers:
As a result of their tendency to use...
Cultural barriers:
Differences in values, beliefs, religion, knowledge, and tradition can significantly impact communication. Awareness of nonverbal cues is critical, especially when conversing with a patient from a different culture. What appears appropriate in one culture may be inappropriate in another.
Semantic barriers:
As a result of their tendency to use...
3.6K