Noisy tensor completion via the sum-of-squares hierarchy
1Harvard John A. Paulson School of Engineering and Applied Sciences, Boston, USA.
Abstract:
In the noisy tensor completion problem we observe m entries (whose location is chosen uniformly at random) from an unknown tensor T. We assume that T is entry-wise close to being rank r. Our goal is to fill in its missing entries using as few observations as possible. Let . We show that if then there is a polynomial time algorithm based on the sixth level of the sum-of-squares hierarchy for completing it. Our estimate agrees with almost all of T's entries almost exactly and works even when our observations are corrupted by noise. This is also the first algorithm for tensor completion that works in the overcomplete case when , and in fact it works all the way up to . Our proofs are short and simple and are based on establishing a new connection between noisy tensor completion (through the language of Rademacher complexity) and the task of refuting random constraint satisfaction problems. This connection seems to have gone unnoticed even in the context of matrix completion. Furthermore, we use this connection to show matching lower bounds. Our main technical result is in characterizing the Rademacher complexity of the sequence of norms that arise in the sum-of-squares relaxations to the tensor nuclear norm. These results point to an interesting new direction: Can we explore computational vs. sample complexity tradeoffs through the sum-of-squares hierarchy?
More Related Videos
07:53Author Spotlight: Advancing 3D Modeling for Enhanced Diagnosis and Treatment of Pulmonary Nodules in Early-Stage Lung Cancer
Published on: October 13, 2023
11:38Volume Segmentation and Analysis of Biological Materials Using SuRVoS Super-region Volume Segmentation Workbench
Published on: August 23, 2017
Related Concept Videos
Vector Algebra: Method of Components
In many applications, the magnitudes and directions of...
Residuals and Least-Squares Property
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
Routh-Hurwitz Criterion II
The first scenario occurs when a singular zero appears in the first column of the Routh table. This situation creates a division by zero issues. To resolve this, a small positive or negative number, denoted as epsilon (∈), is substituted for the zero. The stability analysis proceeds by assuming a sign for ∈. If ∈ is positive, any sign change in the first...
Area Computation by the Alternative Coordinate Method
Scalar Product (Dot Product)
The scalar product of two vectors is obtained by multiplying...
Extraction: Partition and Distribution Coefficients
For extracting a solute from an aqueous phase into an...
