Robust Multiview Subspace Learning With Nonindependently and Nonidentically Distributed Complex Noise

Area of Science:

• Machine Learning
• Computer Vision
• Data Science

Background:

• Multiview Subspace Learning (MSL) is crucial for extracting latent representations from data with multiple views.
• Existing MSL methods often oversimplify noise assumptions, using independent identically distributed (i.i.d.) Gaussian or Laplacian models.
• Practical multiview data exhibit complex, non-identical, and correlated noise patterns that are not captured by current models.

Purpose of the Study:

• To develop a more robust MSL model that accounts for the intricate noise characteristics present in real-world multiview data.
• To improve the accuracy and effectiveness of MSL in various applications by addressing noise underestimation.

Main Methods:

• Modeled noise in each view using a Dirichlet Process Gaussian Mixture Model (DPGMM) to capture complex distributions.
• Ensured non-identical noise across views by assigning distinct DPGMM parameters for each view.
• Incorporated non-independent noise correlations using hierarchical Dirichlet Processes (DP) for shared high-level priors.
• Integrated these noise modeling techniques into a unified graphical model solved via variational Bayes.

Main Results:

• The proposed MSL method demonstrated superior performance compared to state-of-the-art techniques.
• Experimental validation across 3D reconstruction simulations, multiview face modeling, and background subtraction confirmed the model's effectiveness.
• The DPGMM and hierarchical DP effectively addressed complex, non-identical, and correlated noise.

Conclusions:

• The developed MSL model offers a more realistic and comprehensive approach to handling noise in multiview data.
• This advancement leads to improved performance in tasks requiring robust multiview representation learning.
• The findings highlight the importance of accurate noise modeling for practical MSL applications.