误导的人工智能:如何将种族偏见纳入临床模型
1Division of Hospital Medicine The Miriam Hospital, Lifespan Health System, Warren Alpert Brown School of Medicine, Providence, RI.
The Brown journal of hospital medicine
|March 6, 2025
概括
医疗保健中的人工智能 (AI) 是有前途的,但有可能加剧健康不平等. 本文探讨了人工智能预测模型中的种族偏见,从数据收集到实施.
科学领域:
- 医疗保健人工智能的人工智能
- 医疗信息学 医疗信息学
- 健康 公平 卫生 公平
背景情况:
- 人工智能 (AI) 为许多问题提供解决方案,包括医疗保健方面的挑战.
- 然而,在医疗保健中采用人工智能引发了人们对可能加剧现有的健康不平等的担忧.
- 人工智能系统中的种族偏见是公平提供医疗保健的重要障碍.
研究的目的:
- 调查在医疗保健中使用的AI预测模型中种族偏见的存在和影响.
- 在人工智能模型构建过程中确定特定的点,可以引入种族偏见.
- 探索种族偏见在医疗保健中表现出来的机制.
主要方法:
- 对人工智能模型构建生命周期的分析,包括数据收集和预处理.
- 检查数据标签实践及其对偏见的敏感性.
- 审查人工智能模型实施策略及其对不同影响的潜力.
主要成果:
- 种族偏见可以在多个阶段透到医疗保健AI:原始数据收集,数据处理和数据标签.
- 偏见的数据和标签可以导致预测模型,使现有的健康差异延续或放大.
- 如果不仔细管理,人工智能模型的实施阶段也可能引入或恶化种族偏见.
结论:
- 解决医疗保健中的种族偏见人工智能对于实现健康平等至关重要.
- 缓解策略必须在整个AI开发和部署管道中应用.
- 需要进一步的研究来开发和验证用于检测和纠正医疗AI中的种族偏见的方法.
相关概念视频
Stereotype Content Model
13.9K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
13.9K
Bias
3.7K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
3.7K
Confirmation Biases
5.4K
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
5.4K
Stereotypes, Prejudice, and Discrimination
89.8K
Humans are very diverse and although we share many similarities, we also have many differences. The social groups we belong to help form our identities (Tajfel, 1974). These differences may be difficult for some people to reconcile, which may lead to prejudice toward people who are different. Prejudice is a negative attitude and feeling toward an individual based solely on one’s membership in a particular social group (Allport, 1954; Brown, 2010). Prejudice is common against people who...
89.8K
Bias in Epidemiological Studies
120
Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:
120
Cause and Effect
10.8K
While variables are sometimes correlated because one does cause the other, it could also be that some other factor, a confounding variable, is actually causing the systematic movement in our variables of interest. For instance, as sales in ice cream increase, so does the overall rate of crime. Is it possible that indulging in your favorite flavor of ice cream could send you on a crime spree? Or, after committing crime do you think you might decide to treat yourself to a cone?
10.8K


