确保医疗人工智能安全:以解释性为导向的检测和缓解虚假模型行为和相关数据
Frederik Pahde1, Thomas Wiegand1,2,3, Sebastian Lapuschkin1,4
1Fraunhofer Heinrich Hertz Institute, 10587 Berlin, Germany.
概括
这项研究增强了Reveal2Revise医疗AI安全框架,引入半自动偏差注释,以提高深度神经网络的稳定性,以防止医疗保健应用中的虚假相关性.
科学领域:
- 人工智能的人工智能
- 医疗信息学 医疗信息学
- 计算机视觉 计算机视觉
背景情况:
- 深度神经网络 (DNN) 在医疗应用中至关重要,但容易从虚假的相关性中快捷学习.
- 现有的方法往往单独地解决偏差检测或缓解,而不是全面地解决.
- 解决这些偏见通常需要广泛的专家标签.
研究的目的:
- 审查和增强Reveal2Revise偏见缓解框架.
- 集成基于可解释性的半自动偏差注释功能.
- 提高DNN在医疗任务中的稳定性和可靠性.
主要方法:
- 增强的 Reveal2Revise 框架,具有样本和特征级别偏差注释.
- 利用可解释性方法进行半自动偏差识别.
- 在四个医疗数据集上进行了测试,通过两种方式与受控和现实世界的偏见进行测试.
- 适用于VGG16,ResNet50和视觉变压器模型.
主要成果:
- 成功识别和减轻DNN中的偏差.
- 证明了改进的模型稳定性和适用于现实世界医疗任务的适用性.
- 在各种医疗数据上验证了框架的有效性.
结论:
- 增强的Reveal2Revise框架有效地解决了医学AI中的捷径学习问题.
- 半自动化的偏差注释减少了对广泛的专家标签的依赖.
- 这种方法提高了DNN在临床环境中的安全性和可靠性.
相关概念视频
Data Validation
5.3K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
5.3K
Types of Errors: Detection and Minimization
2.4K
Error is the deviation of the obtained result from the true, expected value or the estimated central value. Errors are expressed in absolute or relative terms.
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
2.4K
Issues And Trends In Healthcare Delivery System
5.8K
The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
5.8K
Stereotype Content Model
14.9K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.9K
Improving Translational Accuracy
11.9K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.9K
Mouse Models of Cancer Study
5.7K
Mice have long served as models for studying human biology and pathology because of their phylogenetic and physiological similarity with humans. They are also easy to maintain and breed in the laboratory, and hence, many inbred strains are now available for research. Studies on mice have contributed immeasurably to our understanding of cancer biology.
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
5.7K


