A complex-valued RTRL algorithm for recurrent neural networks
Related Experiment Videos
1Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, UK. su.goh@imperial.ac.uk
Abstract:
A complex-valued real-time recurrent learning (CRTRL) algorithm for the class of nonlinear adaptive filters realized as fully connected recurrent neural networks is introduced. The proposed CRTRL is derived for a general complex activation function of a neuron, which makes it suitable for nonlinear adaptive filtering of complex-valued nonlinear and nonstationary signals and complex signals with strong component correlations. In addition, this algorithm is generic and represents a natural extension of the real-valued RTRL. Simulations on benchmark and real-world complex-valued signals support the approach.
Related Concept Videos
RL Circuits
Current Growth And Decay In RL Circuits
RLC Circuit as a Damped Oscillator
Consider a series RLC circuit. Here, the presence of resistance in the circuit leads to energy loss due to joule heating in the resistance. Therefore, the total electromagnetic energy in the circuit is no longer constant and decreases with time. Since the magnitude of charge, current, and potential difference continuously decreases, their oscillations are said to be damped. This is...
RL Circuit with Source
The transient response of the circuit is its temporary reaction to the sudden application of the DC source. This response is characterized by a current that exponentially decays to zero as time approaches infinity. During this transitional period, the inductor behaves like a short circuit, causing the source...
Parallel RLC Circuits
A simplified parallel RLC circuit model with a DC input source generating a step response is employed in this context. When the switch is turned on, Kirchhoff's current law is applied, leading to a second-order differential equation.
Linear Approximation in Frequency Domain
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear.