分布外检测作为医学分类机器学习模型的风险控制策略
Chu Weng1,2, Joshua Ward1,3, Wesley Lin1
1Center for Drug Evaluation and Research, U.S. Food and Drug Administration, Silver Spring, Maryland, USA.
Clinical and translational science
|October 23, 2025
概括
外发行 (OOD) 检测算法识别患者不太可能来自训练数据,提高医疗人工智能 (AI) 的可靠性. 这些方法有助于在现实世界医疗保健环境中部署AI时减轻风险.
科学领域:
- 医疗人工智能 医疗人工智能
- 医疗保健中的机器学习
- 算法可靠性 算法可靠性
背景情况:
- 人工智能 (AI) 和机器学习 (ML) 越来越多地用于医学.
- 高风险的医疗人工智能需要强大的性能护.
- 分布外 (OOD) 检测是识别不可靠预测的关键护.
研究的目的:
- 在医疗环境中评估最先进的OOD检测算法.
- 评估OOD检测对改善医疗AI性能和安全的有用性.
- 调查OOD检测是否可以识别代表性不足的患者子集.
主要方法:
- 在三个不同的医疗数据集 (图像,转录组学,时间序列) 上评估了OOD检测算法.
- 利用模拟的训练部署场景来评估算法性能.
- 分析了OOD检测器识别模型性能差和数据不足的患者的能力.
主要成果:
- 一些OOD检测器始终确定了人工智能模型表现不佳的患者.
- OOD检测方法成功标记了在培训数据中代表性不足的患者子集.
- 这些发现表明,OOD检测是提高医疗AI安全性的可行策略.
结论:
- OOD检测算法可以作为医疗AI的有效护.
- 实施OOD检测可以减轻与在临床实践中部署AI相关的风险.
- 对代表性不足的群体进行OOD检测的进一步调查是有必要的.
相关概念视频
Steps in Outbreak Investigation
487
In the ever-evolving field of public health, statistical analysis serves as a cornerstone for understanding and managing disease outbreaks. By leveraging various statistical tools, health professionals can predict potential outbreaks, analyze ongoing situations, and devise effective responses to mitigate impact. For that to happen, there are a few possible stages of the analysis:
487
Detection of Gross Error: The Q Test
6.9K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.9K
Receiver Operating Characteristic Plot
470
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
470
What Are Outliers?
4.9K
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
4.9K
Quantifying and Rejecting Outliers: The Grubbs Test
3.5K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
3.5K
Outliers and Influential Points
6.1K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
6.1K


