在AI模型中评估和减少子组差异:对儿科COVID-19测试结果的分析
Alexander Libin1, Jonah T Treitler2, Tadas Vasaitis3
1AIM AHEAD Consortium, Georgetown-Howard Universities Center for Clinical and Translational Science (GHUCCTS), Medstar Research Health Institute, Georgetown University, Washington, D.C., USA.
medRxiv : the preprint server for health sciences
|October 7, 2024
概括
人工智能 (AI) 医疗保健模型中的子组差异很常见,影响了公平性. 合成数据显示,有可能减少这些差异,改善儿童COVID-19测试中的AI模型公平性.
科学领域:
- 医疗保健人工智能的人工智能
- 机器学习公平性 机器学习公平性
- 健康差异 在健康上的差异
背景情况:
- 医疗保健中的人工智能 (AI) 引发了人们对延续健康差距的担忧.
- 人工智能模型中子组公平性的频率和程度需要进一步调查.
- 了解AI公平性对于公平的医疗保健服务至关重要.
研究的目的:
- 在预测儿科COVID-19测试结果的AI模型中评估子组公平差异的流行率和程度.
- 评估合成数据对减轻已识别的子组差异的影响.
主要方法:
- 利用来自美国国家健康访谈调查 (NHIS) 的全国代表性儿科数据集 (年龄为0-17岁,n=9,935) 来获得COVID-19测试结果.
- 训练了50个机器学习模型,使用5个算法来评估子组差异.
- 评估模型的曲线下的面积 (AUC) 在12个由社会经济因素定义的小子组与总人口相比.
- 探索合成数据生成技术 (重新采样,生成对抗网络) 以减轻差异.
主要成果:
- 分组差异很普遍,在50.7%的模型中发现.
- 小组AUC通常低于整体AUC,平均差异为0.01 (范围: -0.29到+0.41).
- 在12个子组中,有4个显示出模型之间的统计学上显著差异.
- 综合数据的引入加剧了57.7%的模型中的差异,但使平均AUC差异减少了0.03 (重新抽样) 和0.04 (GANs).
结论:
- 在儿童COVID-19测试的AI模型中存在显著的子组差异.
- 合成数据显示,减少人工智能公平差距是有前途的,尽管需要仔细实施.
- 进一步的研究是必不可少的,以确保公平的AI部署在医疗机构.
相关概念视频
Comparing the Survival Analysis of Two or More Groups
156
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
156
Strategies for Assessing and Addressing Confounding
83
Confounding is a critical issue in epidemiological studies, often leading to misleading conclusions about associations between exposures and outcomes. It occurs when the relationship between the exposure and the outcome is mixed with the effects of other factors that influence the outcome. Given that, addressing confounding is of high importance for drawing accurate inferences in research.
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
83


