Differential competitive learning for centroid estimation and phoneme recognition
Abstract:
A comparison is made of a differential-competitive-learning (DCL) system with two supervised competitive-learning (SCL) systems for centroid estimation and for phoneme recognition. DCL provides a form of unsupervised adaptive vector quantization. Standard stochastic competitive-learning systems learn only if neurons win a competition for activation induced by randomly sampled patterns. DCL systems learn only if the competing neurons change their competitive signal. Signal-velocity information provides unsupervised local reinforcement during learning. The sign of the neuronal signal derivative rewards winners and punishes losers. Standard competitive learning ignores instantaneous win-rate information. Synaptic fan-in vectors adaptively quantize the randomly sampled pattern space into nearest-neighbor decision classes. More generally, the synaptic-vector distribution estimates the unknown sampled probability density function p( x). Simulations showed that unsupervised DCL-trained synaptic vectors converged to class centroids at least as fast as, and wandered less about these centroids than, SCL-trained synaptic vectors did. Simulations on a small set of English phonemes favored DCL over SCL for classification accuracy.
Related Concept Videos
Centroid of a Body
For a homogeneous body with constant density, the centroid can usually be found using equations representing a balance of the moments of the body's volume. If the...
Centroid of a Body: Problem Solving
The x-coordinates and y-coordinates of each element's...
Classification of Signals
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
Linear Approximation in Frequency Domain
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear.
Differential Leveling
Centroid for the Paraboloid of Revolution
The centroid for the paraboloid of revolution is the point where all the mass of the paraboloid is concentrated. This centroid is important for engineering applications, as it determines how forces are...

