Robust adaptive filtering using recursive weighted least squares with combined scale and variable forgetting factors
Branko Kovačević1, Zoran Banjac2, Ivana Kostić Kovačević3
1School of Electrical Engineering, University of Belgrade, Bulevar kralja Aleksandra 73, Belgrade, Serbia.
Summary
This study introduces an adaptive robustified filter for estimating time-varying parameters in noisy, non-stationary environments. The novel algorithm effectively handles impulsive noise and estimates parameters and noise variance simultaneously.
Area of Science:
- Signal Processing
- Adaptive Filtering
- Robust Estimation
Background:
- Non-stationary environments and impulsive noise pose significant challenges for parameter estimation.
- Traditional recursive weighted least squares methods struggle with time-varying parameters and non-Gaussian noise.
- Accurate estimation is crucial for system identification and control in dynamic systems.
Purpose of the Study:
- To propose a new adaptive robustified filter algorithm for recursive weighted least squares.
- To address the challenges of time-varying parameter estimation in non-stationary and impulsive noise environments.
- To simultaneously estimate filter parameters and noise variance.
Main Methods:
- Developed a recursive weighted least squares algorithm with combined scale and variable forgetting factors.
- Extended approximate maximum likelihood (M-estimation) for robust estimation of parameters and noise variance.
- Employed a variable forgetting factor adaptively calculated using a robustified prediction error criterion.
Main Results:
- The proposed algorithm effectively reduces the impact of impulsive noise in both stationary and non-stationary conditions.
- Simultaneous estimation of filter parameters and noise variance was achieved.
- Demonstrated feasibility in system identification using finite impulse response (FIR) filter applications.
Conclusions:
- The adaptive robustified filter provides a robust solution for time-varying parameter estimation under challenging noise conditions.
- The combined use of M-robust estimation and adaptive variable forgetting factors enhances estimation accuracy.
- The approach is suitable for practical applications in system identification and signal processing.
Related Concept Videos
Residuals and Least-Squares Property
9.7K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
9.7K
Linear Approximation in Frequency Domain
418
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
418
Calibration Curves: Linear Least Squares
4.9K
A calibration curve is a plot of the instrument's response against a series of known concentrations of a substance. This curve is used to set the instrument response levels, using the substance and its concentrations as standards. Alternatively, or additionally, an equation is fitted to the calibration curve plot and subsequently used to calculate the unknown concentrations of other samples reliably.
For data that follow a straight line, the standard method for fitting is the linear...
For data that follow a straight line, the standard method for fitting is the linear...
4.9K
Scaling
630
In designing and analyzing filters, resonant circuits, or circuit analysis at large, working with standard element values like 1 ohm, 1 henry, or 1 farad can be convenient before scaling these values to more realistic figures. This approach is widely utilized by not employing realistic element values in numerous examples and problems; it simplifies mastering circuit analysis through convenient component values. The complexity of calculations is thereby reduced, with the understanding that...
630
Upsampling
682
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
682
Reconstruction of Signal using Interpolation
820
Signal processing techniques are essential for accurately converting continuous signals to digital formats and vice versa. When a continuous signal is sampled with a period T, the resulting sampled signal exhibits replicas of the original spectrum in the frequency domain, spaced at intervals equal to the sampling frequency. To handle this sampled signal, a zero-order hold method can be applied, which creates a piecewise constant signal by retaining each sample's value until the next...
820
