使用新型GBO和SSG增强和改进不平衡类数据的性能:比较分析
Md Manjurul Ahsan1, Md Shahin Ali2, Zahed Siddique3
1School of Industrial and Systems Engineering, University of Oklahoma, Norman, OK 73019, USA.
概括
本研究介绍了基于生成对抗网络 (GAN) 的新型过量采样 (GBO) 和支持矢量机器-SMOTE-GAN (SSG) 技术,以解决机器学习中的类失衡问题 (CIP). 这些方法提高了少数群体类别的分类准确性,优于现有的方法.
科学领域:
- 机器学习 机器学习
- 数据科学数据科学数据科学
- 人工智能的人工智能
背景情况:
- 阶级不平衡在机器学习中构成了重大挑战,导致偏见的模型和少数阶级的表现不佳.
- 传统的过量采样方法,如合成少数群体过量采样技术 (SMOTE),可以创建重叠的合成样本,加剧偏差.
- 生成对抗网络 (GAN) 显示出产生现实的数据的希望,但训练起来很复杂.
研究的目的:
- 提出新的技术,有效地解决阶级不平衡问题.
- 克服现有的过量采样方法的局限性,特别是SMOTE.
- 在不平衡的数据集上增强机器学习模型的性能.
主要方法:
- 开发了两种新技术:基于GAN的过量采样 (GBO) 和支持矢量机-SMOTE-GAN (SSG).
- 在九个不平衡的基准数据集上对GBO和SSG的评估.
- 拟议方法与现有的基于SMOTE的方法进行比较.
主要成果:
- 在基准数据集上,SSG和GBO的表现优于现有的几种基于SMOTE的方法.
- 拟议的SSG和GBO方法在不同测试数据百分比 (20%,30%,40%) 中对少数群体类别进行分类时,达到90%以上的准确性.
- SSG生成了呈现高斯分布的合成少数样本,这种特征通常很难用标准SMOTE或SVM-SMOTE实现.
结论:
- 新的GBO和SSG技术有效地缓解了阶级不平衡问题.
- 这些方法在少数民族类别分类准确度上有了显著的改进.
- 由于SSG能够生成高斯分布式合成数据,因此它在不平衡的学习任务中更有用.
相关概念视频
Aggregates Classification
325
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
325
Improving Translational Accuracy
10.4K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
10.4K
Generalization, Discrimination, and Extinction
557
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
557
Quantifying and Rejecting Outliers: The Grubbs Test
1.6K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.6K
Classification of Systems-II
146
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
146
Force Classification
1.2K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.2K


