在人口队列数据中导航严重的阶级不平衡
概括
用不平衡的数据预测像多发性骨髓瘤这样的罕见疾病是具有挑战性的. 异常检测模型的性能优于传统方法,但没有一种方法是普遍最佳的;临床应用指导模型选择.
科学领域:
- 机器学习 机器学习
- 医疗信息学 医疗信息学
- 基因组学就是基因组学.
背景情况:
- 阶级不平衡在大型人群研究中对罕见疾病结果的预测建模提出了重大挑战.
- 传统的机器学习算法通常在不平衡的数据集上表现出偏差的性能和糟糕的概括性.
研究的目的:
- 利用蛋白质学和临床数据系统地评估各种方法,以缓解预测多发性骨髓瘤的类失衡.
- 为了比较标准分类器,重新采样技术,异常检测,以及用于罕见疾病预测的基础模型.
主要方法:
- 比较了XGBoost,物流回归,SMOTE,隔离森林,局部异常因素,一类SVM,自动编码器和TabPFN.
- 引入了一个顺序的XGBoost组合 (SeqXGB) 以优先考虑精度.
- 在英国生物库数据上使用标准分类性能指标评估模型.
主要成果:
- 与传统分类器 (XGBoost,物流回归) 相比,异常检测模型显示出更高的概括性.
- SMOTE没有改善,甚至可能恶化预测性能.
- SeqXGB显著降低了假阳性,但也显著降低了灵敏度.
结论:
- 没有一种单一的方法可以普遍解决类不平衡问题;模型选择必须与临床应用以及虚假阳性和阴性之间的权衡保持一致.
- 研究结果强调,在评估罕见疾病的机器学习模型时,需要考虑具体的临床目的 (例如,查与诊断).
相关概念视频
01:29Bias in Epidemiological Studies
1.2K
Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:
1.2K
01:20Comparing the Survival Analysis of Two or More Groups
538
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
538
01:27Confounding in Epidemiological Studies
555
Confounding in statistical epidemiology represents a pivotal challenge, referring to the distortion in the perceived relationship between an exposure and an outcome due to the presence of a third variable, known as a confounder. This variable is associated with both the exposure and the outcome but is not a direct link in their causal chain. Its presence can lead to erroneous interpretations of the exposure's effect, either exaggerating or underestimating the true association. This...
555
01:25Statistical Methods for Analyzing Epidemiological Data
875
Epidemiological data primarily involves information on specific populations' occurrence, distribution, and determinants of health and diseases. This data is crucial for understanding disease patterns and impacts, aiding public health decision-making and disease prevention strategies. The analysis of epidemiological data employs various statistical methods to interpret health-related data effectively. Here are some commonly used methods:
875
01:21Cancer Survival Analysis
630
Cancer survival analysis focuses on quantifying and interpreting the time from a key starting point, such as diagnosis or the initiation of treatment, to a specific endpoint, such as remission or death. This analysis provides critical insights into treatment effectiveness and factors that influence patient outcomes, helping to shape clinical decisions and guide prognostic evaluations. A cornerstone of oncology research, survival analysis tackles the challenges of skewed, non-normally...
630
01:22Estimating Population Mean with Unknown Standard Deviation
8.7K
In practice, we rarely know the population standard deviation. In the past, when the sample size was large, this did not present a problem to statisticians. They used the sample standard deviation s as an estimate for σ and proceeded as before to calculate a confidence interval with close enough results. However, statisticians ran into problems when the sample size was small. A small sample size caused inaccuracies in the confidence interval.
William S. Gosset (1876–1937) of the...
William S. Gosset (1876–1937) of the...
8.7K