Sparse Modal Additive Model.

Area of Science:

• Statistics
• Machine Learning
• Data Science

Background:

• Sparse additive models are effective for high-dimensional data but sensitive to non-Gaussian noise.
• Existing methods using least-squares loss struggle with skewed, heavy-tailed noise, and outliers.

Purpose of the Study:

• Propose a novel robust regression method, the sparse modal additive model (SpMAM).
• Enhance the robustness and interpretability of additive models for high-dimensional data analysis.

Main Methods:

• Integrate modal regression, a data-dependent hypothesis space, and a weighted l_q,1-norm regularizer into additive models.
• Utilize modal regression for robustness to complex noises by learning the conditional mode.
• Employ a data-dependent hypothesis space for adaptivity and l_q,1-norm for sparse variable selection.

Main Results:

• The proposed SpMAM demonstrates statistical guarantees for asymptotic consistency in both regression estimation and variable selection.
• Experimental results on synthetic and real-world datasets confirm the model's effectiveness and robustness.

Conclusions:

• SpMAM offers a robust and interpretable alternative to existing sparse additive models, particularly for datasets with complex noise.
• The method successfully addresses limitations of least-squares based approaches in non-Gaussian noise scenarios.