一种基于高斯混合模型的新蒙特卡洛采样方法,用于不平衡数据分类
Gang Chen1, Binjie Hou1, Tiangang Lei1
1Department of Mathematics, Dalian Maritime University, Dalian 116026, China.
Mathematical biosciences and engineering : MBE
|December 5, 2023
概括
基于高斯混合模型 (MCS-GMM) 的新蒙特卡洛采样算法通过生成现实的合成样本,有效地解决了不平衡的数据分类问题. 这种方法通过考虑数据的复杂性和减少重叠来提高模型性能,优于现有技术.
科学领域:
- 机器学习 机器学习
- 数据科学数据科学数据科学
- 人工智能的人工智能
背景情况:
- 不平衡的数据分类是机器学习的一个重大挑战.
- 现有的方法往往无法解释不平衡分布的复杂性,导致有偏见的模型.
- 当前的数据级和算法级技术可能会过度强调少数数据中的某些困难因素.
研究的目的:
- 提出一种基于高斯混合模型 (MCS-GMM) 的新型蒙特卡洛采样算法,用于不平衡数据的分类.
- 为了生成更好地代表不平衡数据集的底层分布的合成数据.
- 为了减轻数据重叠的影响,并改善少数阶级的学习过程.
主要方法:
- 使用高斯混合模型 (GMM) 调整不平衡的数据分布.
- 应用蒙特卡洛算法来生成新的合成数据点.
- 使用三西格玛规则来分类数据并减少重叠.
- 根据邻近的近距离和概率密度函数分配实例权重.
主要成果:
- 拟议的MCS-GMM方法在处理不平衡的数据集方面表现出有效性.
- 实验结果显示,与现有方法比如合成少数人过量采样技术 (SMOTE) 相比,其性能优越.
- 该方法成功地在复杂的区域生成样本,解决了先前技术的局限性.
结论:
- 对于不平衡的数据分类,MCS-GMM提供了一个强大的解决方案.
- 该方法通过创建更具信息性的合成数据来增强模型的概括性.
- 这种技术在解决机器学习中的数据不平衡挑战方面提供了宝贵的进步.
相关概念视频
Random Sampling Method
11.2K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest. Among the various sampling methods used by...
11.2K
Cluster Sampling Method
11.9K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
11.9K
Sampling Distribution
12.8K
Given simple random samples of size n from a given population with a measured characteristic such as mean, proportion, or standard deviation for each sample, the probability distribution of all the measured characteristics is called a sampling distribution. How much the statistic varies from one sample to another is known as the sampling variability of a statistic. You typically measure the sampling variability of a statistic by its standard error. The standard error of the mean is an example...
12.8K
Stratified Sampling Method
12.0K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a stratified sample, divide the population into groups called strata and then take a...
To choose a stratified sample, divide the population into groups called strata and then take a...
12.0K
Binomial Probability Distribution
10.9K
A binomial distribution is a probability distribution for a procedure with a fixed number of trials, where each trial can have only two outcomes.
The outcomes of a binomial experiment fit a binomial probability distribution. A statistical experiment can be classified as a binomial experiment if the following conditions are met:
There are a fixed number of trials. Think of trials as repetitions of an experiment. The letter n denotes the number of trials.
There are only two possible outcomes,...
The outcomes of a binomial experiment fit a binomial probability distribution. A statistical experiment can be classified as a binomial experiment if the following conditions are met:
There are a fixed number of trials. Think of trials as repetitions of an experiment. The letter n denotes the number of trials.
There are only two possible outcomes,...
10.9K
Expected Frequencies in Goodness-of-Fit Tests
2.5K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
2.5K


