Related Concept Videos
Upsampling
Sampling Methods: Overview
In analytical chemistry, the choice of...
Sampling Theorem
Aggregates Classification
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Classification of Signals
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
Survival Tree
Building a Survival Tree
Constructing a...
You might also read
Related Articles
Articles linked to this work by shared authors, journal, and citation graph.
Neoadjuvant immunotherapy and the stepwise risk of postoperative atrial fibrillation: a propensity score-matched analysis isolating surgical and biological triggers.
Effectiveness of a mobile application-based program for enhancing independent menstrual management skills in adolescent girls with mild intellectual disabilities: A parallel-group randomized controlled trial.
Enhancing crayfish sex identification with Kolmogorov-Arnold networks and stacked autoencoders.
Related Experiment Video
Updated: Sep 17, 2025

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
Published on: October 11, 2018
A comprehensive evaluation of oversampling techniques for enhancing text classification performance.
Salimkan Fatma Taskiran1, Bahaeddin Turkoglu2, Ersin Kaya1
1Department of Computer Engineering, Konya Technical University, Konya, 42250, Turkey.
Class imbalance in text classification hinders model performance. This study benchmarks Synthetic Minority Over-sampling Technique (SMOTE) and its variants on transformer-embedded data, offering insights for robust natural language processing.
Area of Science:
- Natural Language Processing
- Machine Learning
- Data Science
Background:
- Class imbalance is a critical challenge in text classification, impairing model learning of minority classes.
- Skewed data distributions, following the 'garbage in, garbage out' principle, can lead to suboptimal performance even with advanced models.
Purpose of the Study:
- To systematically benchmark the effectiveness of the Synthetic Minority Over-sampling Technique (SMOTE) and its 30 variants.
- To evaluate these oversampling methods in the context of transformer-embedded text classification.
- To provide practical guidance for selecting appropriate oversampling techniques for imbalanced datasets.
Main Methods:
- Utilized two benchmark datasets: TREC and Emotions.
- Employed the MiniLMv2 transformer model for semantic text vectorization.
- Applied six distinct machine learning algorithms for classification tasks.
- Compared performance using F1-Score and Balanced Accuracy under balanced and imbalanced scenarios.
- Validated results using the Friedman test for statistical significance.
Main Results:
- Demonstrated significant performance variations among different SMOTE variants across datasets and classifiers.
- Identified specific SMOTE techniques that effectively mitigate the negative impact of class imbalance.
- Provided empirical evidence on the suitability of oversampling methods for transformer-based text classification.
Conclusions:
- The choice of SMOTE variant significantly impacts the performance of text classifiers on imbalanced data.
- Transformer embeddings combined with appropriate oversampling techniques can lead to more robust and fair NLP models.
- This large-scale benchmarking offers practical insights for practitioners dealing with imbalanced text classification challenges.

