在从偏见样本到人群的概括过程中纠正绩效指标偏差
Peijin Han1, Guanghao Zhang1, V G Vinod Vydiswaran1
1University of Michigan, Ann Arbor, MI, USA.
Studies in health technology and informatics
|August 8, 2025
概括
本研究介绍了反向概率权衡方法,以纠正预测算法性能指标 (灵敏度,特异性,PPV,NPV) 在使用偏差样本或推断不同人群的值时. 对于小样本大小,建议使用标准细胞权重.
科学领域:
- 生物统计学 生物统计学
- 医疗保健中的机器学习
- 流行病学 流行病学
背景情况:
- 预测算法性能在医疗保健中至关重要,但通常在非代表性患者样本上进行评估.
- 像灵敏度,特异性,正预测值 (PPV) 和负预测值 (NPV) 这样的指标在适用于与样本不同的人群时可能是不准确的.
- 当样本有故意偏见或将性能推断为特定患者群体时,就会出现挑战.
研究的目的:
- 开发和说明纠正预测算法性能指标 (灵敏度,特异性,PPV,NPV) 的方法.
- 为了应对这些指标的偏见抽样和人口推断的挑战.
- 为了比较标准单元权重和后勤回归权重用于性能指标校正.
主要方法:
- 使用逆概率权重方法,特别是标准单元权重和后勤回归权重.
- 基于基础患者分布的绩效指标的衍生校正公式.
- 进行模拟实验,包括识别患有痴呆症的患者,以在各种样本大小和流行情况中比较校正方法.
主要成果:
- 反向概率权重方法有效地纠正估计的算法性能指标.
- 标准细胞权重表现出优于逻辑回归权重的性能,在样本大小小小,层次信息有限的场景中.
- 这项研究经验验证了权衡方法在提高度量准确性方面的实用性.
结论:
- 权重方法提供了一个强大的方法来调整预测算法性能指标,以偏向样本和人口推理.
- 在小样本大小和可用的分层数据条件下,标准细胞权重是性能校正的首选方法.
- 准确的性能评估对于基于预测算法的可靠临床决策至关重要.
更多相关视频
06:55Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
14.6K
16:23Automated, Quantitative Cognitive/Behavioral Screening of Mice: For Genetics, Pharmacology, Animal Cognition and Undergraduate Instruction
Published on: February 26, 2014
14.5K
相关概念视频
Bias
4.9K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
4.9K
Systematic Error: Methodological and Sampling Errors
2.3K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
2.3K
Bias in Epidemiological Studies
683
Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:
683
Regression Toward the Mean
6.5K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.5K
Contaminants and Errors
142
Effective sample preparation is crucial for accurate and reliable laboratory analysis. During this process, two significant sources of error can arise: concentration bias from improper sample splitting and contamination caused by methods used to reduce particle size, such as grinding or homogenization. Identifying and minimizing these potential errors is crucial to ensuring the validity of the analysis.
Another key consideration is determining the appropriate number of samples required to...
Another key consideration is determining the appropriate number of samples required to...
142
Accuracy and Errors in Hypothesis Testing
290
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
290
