On the performance of single-layered neural networks

This paper studies the performance of single-layered neural networks. This study begins with the performance of single-layered neural networks trained using the outer-product rule. The outer-product rule is a suboptimal learning scheme, resulting under certain assumptions from optimal least-squares training of single-layered neural networks with respect to their analog output. Extensive analysis reveals the improvement on the network performance caused by its optimal least-squares training. The effect of the training scheme on the performance of single-layered neural networks with binary output is exhibited by experimentally comparing the performance of single-layered neural networks trained with respect to their analog and binary output.