Anisotropic Gaussian kernel adaptive filtering by Lie-group dictionary learning
Tomoya Wada1, Kosuke Fukumori1, Toshihisa Tanaka1
1Department of Electrical and Electronic Engineering, Tokyo University of Agriculture and Technology, Koganei-shi, Tokyo, Japan.
Plos One
|August 16, 2020
Summary
This study introduces a new kernel adaptive filtering algorithm using non-isotropic Gaussian kernels. The method adapts precision matrices on a Lie group, enhancing flexibility and improving filtering accuracy.
Area of Science:
- Machine Learning
- Signal Processing
- Kernel Methods
Background:
- Kernel adaptive filters are crucial for signal processing tasks.
- Conventional filters often use isotropic kernels, limiting flexibility.
- Adapting kernel parameters, especially precision matrices, requires specialized methods.
Purpose of the Study:
- To propose a novel kernel adaptive filtering algorithm.
- To generalize kernel parameterization using symmetric positive definite (SPD) precision matrices.
- To develop update rules for SPD precision matrices on a Lie group.
Main Methods:
- Utilizing non-isotropic Gaussian kernels for increased filter flexibility.
- Employing an adaptation algorithm to search a wider parameter space.
- Establishing update rules for SPD precision matrices on the Lie group of SPD matrices.
- Applying a least-squares criterion for error minimization and ℓ1-type regularization to prevent overfitting.
Main Results:
- The proposed algorithm successfully adapts SPD precision matrices while preserving their properties.
- The non-isotropic kernels provide greater flexibility compared to conventional methods.
- Experimental results validate the effectiveness of the novel kernel adaptive filtering approach.
Conclusions:
- The novel algorithm offers a more flexible and powerful kernel adaptive filtering framework.
- Adapting parameters on the Lie group of SPD matrices is key to the method's success.
- The approach demonstrates significant potential for advanced signal processing applications.
Related Concept Videos
Linear Approximation in Frequency Domain
289
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
289
Gaussian Elimination: Problem Solving
96
Systems of linear equations in several variables are pivotal in modeling complex scenarios involving multiple unknowns and constraints. Such systems are widely used in various fields to represent relationships where several conditions must be simultaneously satisfied. Each variable in the system corresponds to an unknown quantity, while each equation imposes a linear constraint, leading to a structured approach for analyzing and solving real-world problems.A system of three equations with three...
96
Linear Approximation in Time Domain
241
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
241
Gauss's Law: Problem-Solving
2.5K
Gauss's law helps determine electric fields even though the law is not directly about electric fields but electric flux. In situations with certain symmetries (spherical, cylindrical, or planar) in the charge distribution, the electric field can be deduced based on the knowledge of the electric flux. In these systems, we can find a Gaussian surface S over which the electric field has a constant magnitude. Furthermore, suppose the electric field is parallel (or antiparallel) to the area vector...
2.5K
Gauss's Law: Planar Symmetry
9.1K
A planar symmetry of charge density is obtained when charges are uniformly spread over a large flat surface. In planar symmetry, all points in a plane parallel to the plane of charge are identical with respect to the charges. Suppose the plane of the charge distribution is the xy-plane, and the electric field at a space point P with coordinates (x, y, z) is to be determined. Since the charge density is the same at all (x, y) - coordinates in the z = 0 plane, by symmetry, the electric field at P...
9.1K
Gauss's Law
9.1K
If a closed surface does not have any charge inside where an electric field line can terminate, then the electric field line entering the surface at one point must necessarily exit at some other point of the surface. Therefore, if a closed surface does not have any charges inside the enclosed volume, then the electric flux through the surface is zero. What happens to the electric flux if there are some charges inside the enclosed volume? Gauss's law gives a quantitative answer to this question.
9.1K


