小さなサンプルでの特徴ランキング:ベイズベースのアプローチ
Aleksandra Vatian1, Natalia Gusarova1, Ivan Tomilov1
1School of Translational Information Technologies, ITMO University, 197101 St. Petersburg, Russia.
Entropy (Basel, Switzerland)
|August 28, 2025
まとめ
新しいベイジアンアプローチは 小規模なデータセットでも 特徴を効果的にランク付けします このモデルフリーメソッドは,特徴の重要性分析の既存の技術と比較して優れた安定性と一貫性を示しています.
科学分野:
- 機械学習
- 統計モデリング
背景:
- 特徴のランキングは,ターゲット属性を予測するために不可欠ですが,研究はしばしばランキングよりも選択/抽出に焦点を当てています.
- 既存の方法は特に限られたデータで 安定性が欠けているかもしれません
研究 の 目的:
- 小規模なデータセットの特徴ランキングのための新しいモデルフリー・ベイジアン・メソッドを導入する.
- 機能ランキングアルゴリズムを比較するための枠組みを確立する.
主な方法:
- 機能ランキングのベイジアンアプローチ.
- 古典的な周波数方法,物流回帰,SHAPとの実験的比較.
- 合成データと公衆医療データセットの検証
主要な成果:
- 提案された方法は50個のサンプルでも高い自己一貫性 (安定性) を示しています.
- 安定性と単調性において ロジスティック回帰とSHAPを上回る.
- サンプルサイズが大きくなるにつれて,他の方法と比べられるか,より優れた性能を示す.
結論:
- ベイジアン特性ランキング方法は,小さなデータセットに対して堅牢で信頼性があります.
- 影響因子分析の安定性と一貫性を大幅に改善します.
- 業界や法医学や心理学など 様々な分野に適用できます
関連する概念動画
Ranks
286
Unlike parametric methods, nonparametric statistics are ideal for nominal and ordinal data, requiring fewer assumptions about the population's nature or distribution. This makes nonparametric methods easier to apply and interpret, as they do not depend on parameters like mean or standard deviation. One common approach in nonparametric analysis is to sort data according to a specific criterion. For instance, we might arrange weather data from hottest to coldest days in a month or rank cities...
286
Expected Frequencies in Goodness-of-Fit Tests
2.6K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
2.6K
Quantifying and Rejecting Outliers: The Grubbs Test
2.0K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
2.0K
Survival Tree
159
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
159
Friedman Two-way Analysis of Variance by Ranks
296
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
296
Cluster Sampling Method
12.7K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
12.7K


