人工智能和XAI的第二意见:人类-人工智能合作中错误确认的危险
Rikard Rosenbacke1, Åsa Melhus2, Martin McKee3
1Centre for Corporate Governance, Department of Accounting, Copenhagen Business School, Frederiksberg, Denmark rikard@rosenbacke.com.
Journal of medical ethics
|July 29, 2024
概括
由于普遍存在的"错误确认"错误,人工智能 (AI) 可能无法可靠地替代医生的第二意见. 可解释性AI (XAI) 和谨慎的整合对于安全的临床决策至关重要.
科学领域:
- 医学伦理 医学伦理
- 人工智能在医学中的应用
- 临床决策支持 临床决策支持
背景情况:
- 人工智能 (AI) 作为临床决策中的第二意见的作用受到辩论.
- 人们担心存在"虚假确认"错误,即人工智能错误地验证了错误的人类诊断.
- 现有的辩论还没有完全纳入可解释的人工智能 (XAI) 能力.
研究的目的:
- 提出一个框架,以了解医生-人工智能合作中的决策错误.
- 评估临床实践中虚假确认错误的流行程度和影响.
- 为整合人工智能作为第二意见提供一个务实的方法.
主要方法:
- 对医生-人工智能决策错误的概念框架开发.
- 对虚假确认错误率的新出现证据的审查.
- 模拟以量化这些错误对诊断准确性的影响.
主要成果:
- 错误的确认错误可能在临床环境中很普遍.
- 这些错误可以显著降低诊断准确度,可能达到5%-30%.
- 可解释的人工智能 (XAI) 具有潜力,但需要关键的医生参与.
结论:
- 人工智能不应该取代人类医生的判断,而是作为谨慎的第二意见.
- 医生应该在咨询AI之前形成初步诊断.
- 像点击和对XAI解释的批判性评估这样的策略对于安全的AI集成至关重要.
相关概念视频
False Memories
81
False memories represent a cognitive distortion in which individuals recall events that did not happen, or remember them in an altered form. This phenomenon highlights the brain's constructive nature in processing and recalling memories, emphasizing that memory is not a perfect representation of past events but rather a dynamic reconstruction influenced by various factors.
One primary source of false memories is misattribution, where individuals incorrectly associate external information...
One primary source of false memories is misattribution, where individuals incorrectly associate external information...
81
Confirmation Biases
5.5K
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
5.5K
Cause and Effect
10.9K
While variables are sometimes correlated because one does cause the other, it could also be that some other factor, a confounding variable, is actually causing the systematic movement in our variables of interest. For instance, as sales in ice cream increase, so does the overall rate of crime. Is it possible that indulging in your favorite flavor of ice cream could send you on a crime spree? Or, after committing crime do you think you might decide to treat yourself to a cone?
10.9K
The Availability Heuristic
5.9K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
5.9K
Non-equilibrium in the Cell
4.4K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.4K
Stereotype Threat and Self-fulfilling Prophecies
37.6K
When we hold a stereotype about a person, we have expectations that he or she will fulfill that stereotype. A self-fulfilling prophecy is an expectation held by a person that alters his or her behavior in a way that tends to make it true. When we hold stereotypes about a person, we tend to treat the person according to our expectations. This treatment can influence the person to act according to our stereotypic expectations, thus confirming our stereotypic beliefs. Research by Rosenthal and...
37.6K


