Adaptive estimation of instance-dependent noise transition matrix for learning with instance-dependent label noise

Instance-dependent noise (IDN) widely exists in real-world datasets, seriously hindering the effective application of deep neural networks. In contrast to class-dependent noise, IDN is influenced not solely by the class but also by the intrinsic features of the instance. Current methods for addressing IDN typically involve estimating the instance-dependent noise transition matrix (IDNT). However, these approaches often either assume a specific form for the IDNT or rely on anchor points, which can result in significant estimation errors. To tackle this issue, we propose a method that makes no assumptions about the form of IDNT or the need for anchor points. Specifically, by computing similarity scores between each instance's feature representation and the label representations, the instance-label confusion matrix (ILCM) captures the relationships between global instance features and different categories, providing valuable insights into the degree of noise. We then adaptively combine the noisy class posteriors from network predictions (for noisy data) or given labels (for clean data) with the ILCM, weighted by the degree of noise, to enhance the accuracy of IDNT estimation. Finally, the obtained IDNT adjusts the loss function, resulting in a more robust classifier. Comprehensive experiments comparing our method with state-of-the-art approaches on synthetic IDN datasets (F-MNIST, SVHN, CIFAR-10, CIFAR-100) and a real-world noisy dataset (Clothing1M) demonstrate the superiority and effectiveness of our approach.