Related Experiment Videos
Intrinsic logit-based debiasing for class-imbalanced semi-supervised learning
Qianying Tang1, Yue Cheng1, Xiaoyu Guo2
1School of Software Engineering, Beijing Jiaotong University, Beijing, 100044, China.
Abstract:
In Class-Imbalanced Semi-Supervised Learning (CISSL), classifiers suffer from severe confirmation bias, particularly when the class distribution of unlabeled set are unknown or mismatched with that of the labeled set. Existing debiasing methods often rely on impractical assumptions for classifier bias estimation, such as known class priors or risky external proxies. To overcome these limitations, we propose Intrinsic Logit-Based Debiasing (ILBD), a robust post-hoc framework that estimates bias directly from task-relevant data without external dependencies and class priors. ILBD constructs a comprehensive bias estimator by decomposing output logits into two distinct components: (1) Label-Free Intrinsic Bias, derived from non-target K-1 logits by masking target-class maximum logits to capture the model's background distributional skew; and (2) Label-Guided Learning Bias, derived from target-class maximum logits to quantify confidence disparities between head and tail classes arising from varying learning difficulties. To ensure estimation reliability, we further employ a class-adaptive threshold to filter noisy pseudo-labels. By subtracting this estimated bias at inference, ILBD effectively rectifies the classifier's bias directly from the inherent statistical patterns of the training data, without the need for target-prior assumptions or external data. Extensive experiments on CIFAR-10/100-LT, STL-10-LT, and Small-ImageNet-127 demonstrate the effectiveness of ILBD. Our code is available at https://github.com/aroid721/ILBD.
Related Concept Videos
Residuals and Least-Squares Property
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
Regression Toward the Mean
Regression Analysis
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
Logarithmic Differentiation
Quantifying and Rejecting Outliers: The Grubbs Test
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...