在安全关键的环境中对人工智能的负责任部署进行经验性评估要求
Dane A Morey1, Michael F Rayo2, David D Woods2
1The Ohio State University, Columbus, OH, USA. morey.38@osu.edu.
NPJ digital medicine
|June 18, 2025
概括
在医疗保健中评估人工智能 (AI) 需要评估人类-AI合作,而不仅仅是AI准确性. 人工智能增强可以提高或降低护士的表现,强调在关键环境中需要严格测试.
科学领域:
- 医疗保健技术 医疗保健技术 医疗保健技术
- 人与计算机的互动.
- 人工智能的人工智能是人工智能.
背景情况:
- 人工智能 (AI) 在医疗保健等安全关键领域的整合需要强大的评估框架.
- 确保在临床环境中安全,有效和负责任地部署AI是一个越来越大的挑战.
研究的目的:
- 开发和验证一种程序,以实证评估人工智能增强对识别患者紧急情况的人类表现的影响.
- 评估护士和人工智能技术的联合表现.
主要方法:
- 评估了三种人工智能增强技术,包括人工智能建议和解释.
- 这项研究涉及450名护理学生和12名执照护士,评估了10例历史患者病例.
- 我们收集了个人和人类-人工智能联合表现的绩效指标.
主要成果:
- 当算法正确时,护士的表现得到了AI的改善,但当AI误导时,护士的表现降低了.
- 人工智能增强的有效性取决于人工智能的准确性和临床病例的复杂性.
- 联合人类-人工智能系统的性能各不相同,这表明仅靠人工智能能力无法确保安全性或有效性.
结论:
- 在安全关键的环境中部署人工智能,对人类-人工智能联合表现的实证评估至关重要.
- 测试必须包括各种各样的具有挑战性的案例,以揭示AI的局限性和潜在的故障模式.
- 人工智能评估提出了两个最低要求:测量综合性能和评估不同AI准确度水平的性能.
相关概念视频
01:56Ethics in Research
24.1K
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
24.1K
01:30Psychosurgery
116
Psychosurgery, the surgical alteration or permanent removal of brain tissue to alleviate severe psychological conditions, stands as one of the most radical and controversial treatments in the history of mental health care. Its development and application have evolved significantly, marked by dramatic shifts in scientific understanding and ethical perspectives.
Historical Development of Psychosurgery
In the 1930s, Portuguese neurologist Antonio Egas Moniz introduced a surgical procedure designed...
Historical Development of Psychosurgery
In the 1930s, Portuguese neurologist Antonio Egas Moniz introduced a surgical procedure designed...
116
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
184
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
184
01:25Distribution Reliability and Automation
167
Distribution reliability in electrical power systems is critical for ensuring an uninterrupted power supply to consumers at minimal cost. According to IEEE Standard Terms, reliability is the probability that a device will function without failure over a specified time period or amount of usage. For electric power distribution, this translates to maintaining continuous power supply and addressing customer concerns over power outages. Several indices, as defined by IEEE Standard 1366-2012, are...
167
01:30Current Trends in Nursing II
1.4K
Trends in nursing are multifactorial and associated with changes in society, within the nursing profession, and in other professions. Notably, telehealth and remote nursing contribute to successful healthcare delivery for numerous patients and help reduce stress for nurses due to nursing shortages. Nurses can reach patients, monitor their conditions, and interact with them using computers, audio, visual accessories, and telephones—for example, remote patient monitoring systems. Likewise,...
1.4K