Related Experiment Videos
Improving the capacity of complex-valued neural networks with a modified gradient descent learning rule
Abstract:
Jankowski et al. proposed (1996) a complex-valued neural network (CVNN) which is capable of storing and recalling gray-scale images. The convergence property of the CVNN has also been proven by means of the energy function approach. However, the memory capacity of the CVNN is very low because they use a generalized Hebb rule to construct the connection matrix. In this letter, a modified gradient descent learning rule (MGDR) is proposed to enhance the capacity of the CVNN. The proposed technique is derived by applying gradient search over a complex error surface. Simulation shows that the capacity of CVNN with MGDR is greatly improved.
Related Concept Videos
Gradient Vectors and Their Applications
Significance of the Gradient Vector
Maximizing the Directional Derivative
Neural Regulation
Implicit Differentiation: Problem Solving
Gradient Fields