可解释的人工智能的人类因素:临床医生对信任,依赖和绩效的变化
Angus Nicolson1,2, Elizabeth Bradburn3, Yarin Gal4
1Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK. angus.nicolson@eng.ox.ac.uk.
NPJ digital medicine
|November 14, 2025
概括
在医疗保健中的可解释的人工智能 (XAI) 没有显著改善临床医生的信任或依赖,尽管减少了怀孕年龄估计中的错误. 用户的变化凸显了在XAI部署中需要进行人体研究的需要.
科学领域:
- 医疗成像医学成像
- 人工智能的人工智能
- 人与计算机的交互
背景情况:
- 可解释的人工智能 (XAI) 对医疗保健等高风险领域至关重要,以建立用户信任.
- 当前的评估经常使用自动化指标,忽视了关键的以用户为中心的评估.
研究的目的:
- 评估基于原型的XAI模型对临床医生的信任,依赖和在基于图像的妊娠年龄估计中的表现的影响.
- 引入和评估一种新的指标,以适当依赖AI在临床环境中.
主要方法:
- 一个基于原型的XAI模型被调整为从医学图像中估计妊娠年龄.
- 十个超声波仪参与了三阶段的读者研究,以评估XAI模型的影响.
- 测量了临床医生的表现,信任,依赖和信心,包括适当依赖的新指标.
主要成果:
- 该XAI模型将妊娠年龄估计的平均绝对误差 (MAE) 从23.5日降低到15.7天.
- 由XAI模型提供的解释导致MAE进一步减少到14.3天,尽管在统计学上并不显著.
- 参与者对解释的反应各不相同,有些表现更差;信心增加,但信任和依赖没有受到影响.
结论:
- 在临床环境中部署可解释的人工智能 (XAI) 需要仔细考虑用户的变化及其对性能的影响.
- 自动化指标是不够的;人类研究对于理解XAI对临床医生的行为和决策的微妙影响至关重要.
- 这些发现强调了在医疗应用中使用当前XAI方法实现所需的信任和依赖结果的潜在挑战.
相关概念视频
Theory of Attribution II: Kelley's Covariation Theory
470
Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus:...
470
Reliability and Validity
13.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.7K
Theory of Attribution I: Correspondent Inference Theory
423
Correspondent inference theory, proposed by Jones and Davis in 1965, seeks to explain how individuals infer stable personality traits from observed behaviors. It suggests that people attribute actions to underlying dispositions rather than external circumstances, particularly when the behavior appears intentional and socially significant.Voluntary Behavior and Dispositional AttributionAccording to this theory, individuals are more likely to attribute behavior to personal traits when it appears...
423
Fundamental Attribution Error
13.7K
According to some social psychologists, people tend to overemphasize internal factors as explanations—or attributions—for the behavior of other people. They tend to assume that the behavior of another person is a trait of that person, and to underestimate the power of the situation on the behavior of others. They tend to fail to recognize when the behavior of another is due to situational variables, and thus to the person’s state. This erroneous assumption is...
13.7K
Confidence Coefficient
10.3K
The confidence coefficient is also known as the confidence level or degree of confidence. It is the percent expression for the probability, 1-α, that the confidence interval contains the true population parameter assuming that the confidence interval is obtained after sufficient unbiased sampling; for example, if the CL = 90%, then in 90 out of 100 samples the interval estimate will enclose the true population parameter. Here α is the area under the curve, distributed equally under...
10.3K
Confirmation Biases
7.6K
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
7.6K

