Related Experiment Videos
A new dual-scale nearest neighbor statistical feature construction algorithm for imbalanced data oriented to Gaussian
Wei Wang1, Shuang Ouyang2, Fen Liu1
1Business School, Guilin Tourism University, Guilin, 541006, China.
Abstract:
To address the performance degradation of Gaussian Naive Bayes (GNB) classifier on imbalanced datasets caused by sparse minority class features and severe class overlap, this paper proposes a new feature construction algorithm based on dynamic dual-scale nearest neighbor statistical ratio (NNDSR). The core of NNDSR is a dynamic dual-scale nearest neighbor mechanism, which is designed to accurately extract the local aggregation characteristics of samples and the inter-class boundary information. On this basis, new features are generated through cross-class and dual-scale statistical ratio operations. These features possess both strong discriminability and Gaussian distribution adaptability, which can significantly amplify class differences and effectively approximate the core assumptions of GNB. By optimizing the information expression of minority classes and enhancing class separability with these features, the algorithm avoids the information distortion problem of traditional sampling techniques and solves the mismatch between general feature enhancement algorithms and GNB's core assumptions. Comparative experiments were conducted on 22 UCI datasets with varying scales, dimensions and imbalance ratios. Results show that NNDSR significantly outperforms the original data and 16 mainstream algorithms including sampling, feature enhancement and classifier-level optimization methods in core classification metrics such as AUC, G-mean and F-measure, with a notable improvement in the recognition accuracy of minority classes. Scalability tests further confirm its efficiency and stability on datasets with ten-thousand-level samples and within one hundred dimensions. This paper provides a robust new feature construction algorithm for GNB to handle imbalanced data, with strong practical application value.
Related Concept Videos
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance, comparing...
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
Weighted Mean
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
Introduction to Nonparametric Statistics
One of...
Residuals and Least-Squares Property
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
Cluster Sampling Method
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...