What's in a Prior? Learned Proximal Networks for Inverse Problems
Zhenghan Fang1, Sam Buchanan2, Jeremias Sulam1
1Mathematical Institute for Data Science Johns Hopkins University.
Summary
This study introduces learned proximal networks (LPNs) for inverse problems, offering exact proximal operators for data-driven regularizers. A novel proximal matching strategy ensures convergence and reveals learned data priors.
Area of Science:
- Computational imaging
- Machine learning for inverse problems
- Optimization theory
Background:
- Proximal operators are crucial for regularizing ill-posed inverse problems.
- Deep learning models (plug-and-play, deep unrolling) approximate proximal operators but lack theoretical guarantees.
- Current data-driven methods hinder convergence analysis and understanding of learned priors.
Purpose of the Study:
- Introduce a framework for learned proximal networks (LPNs).
- Prove LPNs yield exact proximal operators for data-driven regularizers.
- Develop a training strategy (proximal matching) to recover data distribution priors.
Main Methods:
- Developed a framework for learned proximal networks (LPNs).
- Proved theoretical guarantees for LPNs as exact proximal operators.
- Introduced and analyzed the proximal matching training strategy.
Main Results:
- Learned proximal networks (LPNs) provide exact proximal operators for nonconvex regularizers.
- Proximal matching training provably recovers the log-prior of the data distribution.
- LPNs offer general, unsupervised, and expressive proximal operators for inverse problems.
Conclusions:
- LPNs provide a principled deep learning approach to proximal operators in inverse problems.
- The proximal matching strategy enables convergence guarantees and interpretable prior learning.
- Demonstrated state-of-the-art performance and insights into learned priors from data.
Related Concept Videos
Ampere-Maxwell's Law: Problem-Solving
1.2K
A parallel-plate capacitor with capacitance C, whose plates have area A and separation distance d, is connected to a resistor R and a battery of voltage V. The current starts to flow at t = 0. What is the displacement current between the capacitor plates at time t? From the properties of the capacitor, what is the corresponding real current?
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of the...
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of the...
1.2K
Application of Linearization and Approximation
121
A drone flying through complex terrain often relies on more than one sensing method to estimate small changes in altitude. Along with direct measurements, air pressure provides a useful indirect indicator of vertical movement. Atmospheric pressure decreases as altitude increases, and this relationship is commonly described using an exponential model. Although accurate, converting pressure measurements into altitude values requires calculations that are too complex to perform repeatedly during...
121
Linear Approximation in Time Domain
386
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
386
Protein Networks
4.6K
An organism can have thousands of different proteins, and these proteins must cooperate to ensure the health of an organism. Proteins bind to other proteins and form complexes to carry out their functions. Many proteins interact with multiple other proteins creating a complex network of protein interactions.
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
4.6K
Protein Networks
2.9K
2.9K
Inverse z-Transform by Partial Fraction Expansion
739
The inverse z-transform is a crucial technique for converting a function from its z-domain representation back to the time domain. One effective method for finding the inverse z-transform is the Partial Fraction Method, which involves decomposing a function into simpler fractions with distinct coefficients. These fractions correspond to known z-transform pairs, facilitating the inverse transformation process.
To begin the process, the poles of the function are identified and the function is...
To begin the process, the poles of the function are identified and the function is...
739


