Vicinal Gaussian Transform: Rethinking Source-Free Domain Adaptation Through Source-Informed Label Consistency

Area of Science:

• Artificial Intelligence
• Machine Learning
• Computer Vision

Background:

• Source-free domain adaptation (SFDA) lacks theoretical frameworks for analyzing domain shifts due to missing source data.
• Direct domain comparisons are impossible in SFDA, hindering the development of robust adaptation techniques.

Purpose of the Study:

• To introduce a theoretical framework for SFDA using the Vicinal Gaussian Transform (VGT).
• To propose the Energy-based VGT (EBVGT) for effective domain adaptation by shrinking covariance and reinforcing label consistency.

Main Methods:

• Developed the Vicinal Gaussian Transform (VGT) to model source-informed latent vicinities as Gaussians.
• Introduced the Energy-based VGT (EBVGT), a stochastic differential equation (SDE) that contracts covariance via a denoising mechanism.
• Utilized a recovery-likelihood with a Schrödinger-Bridge smoothness penalty and a BYOL-derived energy function for score estimation.

Main Results:

• The EBVGT effectively denoises vicinal features for adaptation without requiring source data.
• The method eliminates the need for additional learnable parameters for score estimation, unlike conventional deep SDEs.
• Achieved state-of-the-art improvements of 1.3-3.0% (2.0% average) on 2D image and 3D point cloud SFDA benchmarks.

Conclusions:

• The EBVGT provides a novel theoretical and practical approach to SFDA by reframing adaptation as covariance shrinking.
• EBVGT is model- and modality-agnostic, demonstrating broad applicability and efficiency in classification tasks.
• The proposed method significantly advances the performance of SFDA techniques.