机器学习中合成少数超标采样技术的挑战和局限性
Ibraheem M Alkhawaldeh1, Ibrahem Albalkhi2, Abdulqadir Jeprel Naswhan3
1Faculty of Medicine, Mutah University, Karak 61710, Jordan.
World journal of methodology
|January 17, 2024
概括
对不平衡数据的过量采样方法可能导致过度拟合和不准确的合成样本. 考虑替代策略,在机器学习中获得更可靠的结果.
科学领域:
- 机器学习 机器学习
- 数据科学数据科学数据科学
- 人工智能的人工智能
背景情况:
- 类不平衡的数据集在各种机器学习应用中很常见.
- 过量采样是一种广泛采用的技术,用于解决数据不平衡.
- 现有的过量采样方法有局限性,需要仔细考虑.
研究的目的:
- 批判性地评估过量采样技术的局限性.
- 为了突出过度配合和不准确的合成数据生成的风险.
- 提出处理不平衡数据集的替代策略.
主要方法:
- 审查和分析现有的过量采样方法.
- 讨论过量采样的潜在缺点和失败模式.
- 探索替代数据平衡方法.
主要成果:
- 过量采样可能会导致模型过度适应训练数据.
- 生成的合成样本可能不准确地代表少数阶级的分布.
- 局限性要求谨慎应用过量采样.
结论:
- 过度采样的重大缺点是过度拟合和不准确的合成数据生成的可能性.
- 当使用过量采样技术时,用户应该意识到这些限制.
- 为不平衡的数据处理提出了替代策略和未来研究方向.
相关概念视频
Convenience Sampling Method
8.9K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population.
Convenience sampling is a non-random method of sample selection; this method selects individuals that are easily accessible and may result in biased data. For example, a marketing...
Convenience sampling is a non-random method of sample selection; this method selects individuals that are easily accessible and may result in biased data. For example, a marketing...
8.9K
Systematic Sampling Method
10.4K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
Systematic sampling is one of the simplest methods...
Systematic sampling is one of the simplest methods...
10.4K
Random Sampling Method
11.1K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest. Among the various sampling methods used by...
11.1K
Bootstrapping
608
The term "bootstrap" originated in the 19th century as a metaphor for self-improvement or achieving something independently, without external assistance. This concept extends to statistical bootstrapping, a self-contained method for estimating population parameters through resampling, even though it can be computationally intensive. Developed by the American statistician Dr. Bradley Efron in 1979, bootstrapping provides a robust way to perform inference when the original sample size is...
608
Stratified Sampling Method
12.0K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a stratified sample, divide the population into groups called strata and then take a...
To choose a stratified sample, divide the population into groups called strata and then take a...
12.0K
Cluster Sampling Method
11.9K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
11.9K


