稳定性悖论:为什么高预测准确度不能保证在精神病学研究中可靠的特征重要性
1Faculty of Data Science, Musashino University, 3-3-3 Ariake Koto-ku, Tokyo 135-8181, Japan.
Asian journal of psychiatry
|November 7, 2025
概括
由于标签驱动的不稳定性,精神病学研究中的监督机器学习模型可能对特征的重要性不可靠. 无监督的方法提供更一致的特征评估,以提供可靠的解释.
科学领域:
- 精神病学研究精神病学研究
- 机器学习 机器学习
- 数据科学是数据科学.
背景情况:
- 准确的预测在精神病学研究中至关重要,但机器学习模型中的特征重要性可靠性仍然是一个挑战.
- 了解哪些特征驱动预测对于临床解释和干预开发至关重要.
研究的目的:
- 在机器学习中批判性地检查预测准确性和特征重要性稳定性之间的断开关系,用于精神病学研究.
- 在各种机器学习方法中比较功能排名的稳定性.
主要方法:
- 使用了一个hikikomori数据集 (611个实例).
- 使用监督模型 (随机森林,XGBoost,逻辑回归),无监督方法 (特征聚合,高度可变的基因选择) 和统计方法 (斯皮尔曼相关性) 进行了特征选择稳定性的比较.
主要成果:
- 后勤回归实现了最高的分类准确性 (66.20%),但在删除顶级特征后显示特征排名的显著不稳定性.
- 无监督方法和统计方法在特征排名顺序中表现出完美的稳定性.
- 监督模型表现出标签驱动的不稳定性,而不受监督的方法提供了一致的特征重要性评估.
结论:
- 精神病学研究人员应该谨慎地仅依靠监督模型准确性来解释特征.
- 建议将高精度的监督模型与无监督方法相补充,以便在精神病学研究中可靠地评估特征的重要性.
- 无监督方法为特征重要性评估提供了更稳定和更一致的方法.
相关概念视频
01:52Regression Toward the Mean
6.8K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.8K
01:19Survival Tree
375
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
375
01:13Sensitivity, Specificity, and Predicted Value
1.2K
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Sensitivity is the...
1.2K
01:29Reliability and Validity
13.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.7K
01:30Unrealistic Optimism Bias
195
Unrealistic optimism bias is the tendency to overestimate the likelihood of positive outcomes. This cognitive bias makes individuals believe they are less likely to experience failures, setbacks, or risks and more likely to succeed than others. For example, people may assume they are less prone to health issues, accidents, or financial struggles than their peers, even when they share similar risk factors.One key component of this bias is the above-average effect, where individuals perceive...
195
01:13Accuracy and Errors in Hypothesis Testing
555
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
555