新兴的算法偏见:公平性偏移作为模型维护和可持续性的下一个维度
Sharon E Davis1, Chad Dorn1, Daniel J Park1
1Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN 37203, United States.
概括
算法公平性可以在临床预测模型的部署后漂移. 模型更新可能会不可预测地改变公平性,需要对公平的AI进行持续监测.
科学领域:
- 医疗保健中的人工智能
- 临床信息学 临床信息学
- 健康 公平 研究 健康 公平 研究
背景情况:
- 已知临床预测模型中的性能漂移.
- 部署后出现的算法偏差需要进一步研究.
- 了解跨子群体模型性能的时间变化对于公平性至关重要.
研究的目的:
- 探索随着时间的推移,临床预测模型中的公平性偏移.
- 评估模型维护对公平性的影响.
- 了解时间变化如何影响不同人口群体的公平性.
主要方法:
- 利用了来自美国退伍军人事务部设施的11年的数据.
- 训练随机森林模型来预测手术再入院,死亡率和肺炎.
- 每季度对种族和性别的歧视,校准,准确性和公平性 (度量均等) 进行模型性能评估.
主要成果:
- 在原始和更新模型中观察到公平性偏移,涉及1,739,666例手术病例.
- 模型更新对整体业绩的影响超过了公平差距.
- 模型更新对公平性产生了不同的影响,有时会恢复它,有时会加剧偏见.
结论:
- 最初的开发评估不能保证算法的公平性.
- 时间公平性变化可能是复杂的,并且与模型更新策略有意想不到的相互作用.
- 公平的AI部署需要持续监控和促进公平的更新.
相关概念视频
Genetic Drift
39.2K
Natural selection—probably the most well-known evolutionary mechanism—increases the prevalence of traits that enhance survival and reproduction. However, evolution does not merely propagate favorable traits, nor does it always benefit populations.
39.2K
Bias
3.7K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
3.7K
Survival Tree
49
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
49
Mutation, Gene Flow, and Genetic Drift
57.7K
In a population that is not at Hardy-Weinberg equilibrium, the frequency of alleles changes over time. Therefore, any deviations from the five conditions of Hardy-Weinberg equilibrium can alter the genetic variation of a given population. Conditions that change the genetic variability of a population include mutations, natural selection, non-random mating, gene flow, and genetic drift (small population size).
57.7K
Regression Toward the Mean
6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
38
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
38


