小样本的特征排名:基于贝叶斯的方法
Aleksandra Vatian1, Natalia Gusarova1, Ivan Tomilov1
1School of Translational Information Technologies, ITMO University, 197101 St. Petersburg, Russia.
Entropy (Basel, Switzerland)
|August 28, 2025
概括
一种新的贝叶斯式方法有效地排列特征,即使是在小数据集上. 与现有的特征重要性分析技术相比,这种无模型方法显示出更高的稳定性和一致性.
科学领域:
- 机器学习
- 统计模型
背景情况:
- 特性排名对于预测目标属性至关重要,但研究往往侧重于选择/提取而不是排名.
- 现有的方法可能缺乏稳定性,特别是有限的数据.
研究的目的:
- 介绍一个新的,无模型的贝叶斯方法来对小数据集进行特性排名.
- 建立一个比较特征排名算法的框架.
主要方法:
- 一个贝叶斯式的特征排名方法.
- 与经典频率方法,物流回归和SHAP进行实验比较.
- 在合成和公共医疗数据集上进行验证.
主要成果:
- 即使使用50个样本,该方法也显示出很高的自身一致性 (稳定性).
- 在稳定性和单调性方面优于逻辑回归和SHAP.
- 随着样本大小的增加,表现与其他方法相比或优于其他方法.
结论:
- 贝叶斯特征排名方法对于小数据集来说是强大而可靠的.
- 它为影响因素分析提供了显著的稳定性和一致性.
- 适用于工业,法医和心理学等各个领域.
相关概念视频
Ranks
286
Unlike parametric methods, nonparametric statistics are ideal for nominal and ordinal data, requiring fewer assumptions about the population's nature or distribution. This makes nonparametric methods easier to apply and interpret, as they do not depend on parameters like mean or standard deviation. One common approach in nonparametric analysis is to sort data according to a specific criterion. For instance, we might arrange weather data from hottest to coldest days in a month or rank cities...
286
Expected Frequencies in Goodness-of-Fit Tests
2.6K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
2.6K
Quantifying and Rejecting Outliers: The Grubbs Test
2.0K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
2.0K
Survival Tree
159
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
159
Friedman Two-way Analysis of Variance by Ranks
296
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
296
Cluster Sampling Method
12.7K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
12.7K


