用基于集群的减少噪声解决不平衡的数据分类 SMOTE SMOTE
Javad Hemmatian1, Rassoul Hajizadeh2, Fakhroddin Nazari3
1Amol University of Special Modern Technologies, Amol, Iran.
PloS one
|February 10, 2025
概括
一种新的方法,即基于集群的降低噪声SMOTE (CRN-SMOTE),有效地解决了机器学习中的不平衡数据. 通过减少噪音和过量采样少数类别,CRN-SMOTE显著提高了分类性能,超过了现有的技术.
科学领域:
- 机器学习 机器学习
- 数据科学数据科学数据科学
- 人工智能的人工智能
背景情况:
- 不平衡的数据在机器学习中构成重大挑战,对分类算法性能产生负面影响.
- 现有的过量采样方法经常在降低噪音和保持类别分离性方面扎.
研究的目的:
- 引入基于集群的降低噪声SMOTE (CRN-SMOTE),一种新的数据级超采样技术.
- 通过有效的降噪和少数群体类别过量抽样,提高不平衡数据集的分类性能.
主要方法:
- CRN-SMOTE将SMOTE (合成少数人过量采样技术) 与基于集群的独特降噪策略相结合.
- 降噪技术确保每个类别的样本形成不同的集群,这是传统方法无法实现的特征.
- 对四个不平衡的数据集 (ILPD,QSAR,血液,孕产妇健康风险) 进行了评估,使用了诸如科恩卡帕,MCC,F1得分,精度和回忆等关键指标.
主要成果:
- 在所有经过测试的数据集中,CRN-SMOTE的性能始终超过了包括RN-SMOTE,SMOTE-Tomek Link和SMOTE-ENN在内的最先进的方法.
- 在QSAR和孕产妇健康风险数据集上观察到显著的绩效增长.
- CRN-SMOTE在RN-SMOTE上取得了100%的优势,卡帕的平均改进率为6.6%,MCC的4.01%,F1得分为1.87%,精度为1.7%,当SMOTE的邻居设置为5.5时,回忆率为2.05%.
结论:
- 与现有的方法相比,CRN-SMOTE提供了一种优越的处理不平衡数据的方法.
- 拟议的基于集群的降噪是CRN-SMOTE提高分类准确性的关键.
- 这种方法显示了在现实世界不平衡分类场景中提高机器学习模型性能的巨大潜力.
更多相关视频
12:18A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
Published on: January 11, 2020
7.4K
12:27Large-scale Reconstructions and Independent, Unbiased Clustering Based on Morphological Metrics to Classify Neurons in Selective Populations
Published on: February 15, 2017
6.9K
相关概念视频
Cluster Sampling Method
11.6K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
11.6K
Aggregates Classification
299
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
299
Classification of Systems-II
133
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
133
Classification of Systems-I
167
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
167
Classification of Signals
381
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
381
How Data are Classified: Categorical Data
31.6K
A variable, usually notated by capital letters such as X and Y, is a characteristic or measurement that can be determined for each member of a population. Data are the actual values of variables. They may be numbers, or they may be words. Datum is a single value.
Data are classified based on whether they are measurable or not. Categorical data cannot be measured; instead, it can be divided into categories. For example, if Y denotes a person's party affiliation, some examples of Y include...
Data are classified based on whether they are measurable or not. Categorical data cannot be measured; instead, it can be divided into categories. For example, if Y denotes a person's party affiliation, some examples of Y include...
31.6K
