Directed Vectors for Generation of Independent Subspaces in the Bio-inpired Networks

Machine learning, deep learning and neural networks are extensively developed in many fields, with neural networks playing an important role in a wide variety of applications. However, a sufficient explanation of the structure and functionality of complex and deep neural networks is still needed. In this paper, it is shown that bio-inspired networks are useful for the explanation of network functions. First, the asymmetric network is created based on the biological retinal networks. Second, the classification performance of the asymmetric network is compared to that of the symmetric networks. The directional vectors in the asymmetric networks are generated on the adjacent neurons caused by movement stimulus, which create independent subspaces. Vectors for the movement stimulus are reported experimentally to be generated in the layered cortex in the brain. In this paper, it is shown computationally that many directional movement vectors are generated in the layered asymmetric networks, which create also independent subspaces. Further, when the correlational activities of the adjacent cells are represented in the directed vectors, they create independent subspaces than the direct inputs in the networks. These asymmetric subnetworks will facilitate the transmission of sensory information to higher-level processes such as efficient feature extraction, classification, and learning in the layered networks.