Scalable 2D Spectral-Spatial Associated Vision Sensor for Multidimensional Feature Fusion
Na Zhang1, Decai Ouyang1, Haoran Ge2
1State Key Laboratory of Material Processing and Die & Mould Technology, School of Materials Science and Engineering, Huazhong University of Science and Technology, Wuhan, P. R. China.
Abstract:
The perception of multidimensional information (e.g., spatial, temporal, and spectral domains) plays a vital role in fields like remote sensing that require high optical resolution and precision. The current approach typically relies on hyperspectral imaging, a band-by-band image acquisition mode with subsequent feature learning and fusion through post-processing algorithms. Such an asynchronous workflow introduces substantial data redundancy, transmission latency, and high energy consumption, limiting its practical deployment. Here, we propose a novel spectral-spatial associated vision sensor that enables the synchronous acquisition and feature fusion of spectral and spatial information at the hardware level. Specifically, scalable highly oriented 2D Bi2Te3 thin films with broadband response are employed for the fabrication of highly uniform device arrays, thus achieving simultaneous capture of spectral-spatial information. The arrays perform enhanced synaptic behavior under multi-wavelength stimuli, with a maximum enhanced ratio of more than 20, facilitating feature discriminability and recognition efficiency. By leveraging such a synergistic enhancement characteristic, an increased recognition accuracy of 91.12% is achieved for topography recognition on the Indian Pines dataset. These findings demonstrate that the proposed vision sensor streamlines hardware-level data acquisition while improving processing efficiency, thereby establishing a new paradigm for multidimensional information fusion, particularly in scenarios with massive data streams.
More Related Videos
Related Concept Videos
Depth Perception and Spatial Vision
Vision
Nuclear Fusion
A helium nucleus has a mass that is 0.7% less than that of four hydrogen nuclei; this lost mass is converted into energy during the fusion. This reaction produces about...
Color Vision
Tagging and Fusion Proteins
SNAREs and Membrane Fusion
SNAREs exist in pairs that symmetrically interact and catalyze the fusion of the lipid bilayers in vesicle and target organelle. v-SNARE in the vesicle membrane are single polypeptide chains that bind to a complementary t-SNARE, composed of 2...


