Related Experiment Video
Updated: Jun 5, 2026
11:23
Lensless Fluorescent Microscopy on a Chip
Published on: August 17, 2011
High encoding-sensitivity vision sensor with complementary nonlinear neuromorphic computing
Quan Yang1, Chuanqing Wang2, Ziyang Shen3
1College of Integrated Circuits, ZJU-Hangzhou Global Scientific and Technological Innovation Centre, Zhejiang University, Hangzhou, China.
Nature Communications
|June 3, 2026
Summary
This study presents a novel neuromorphic vision sensor using a one-transistor-one-memristor design. It achieves broad light intensity adaptation by combining superlinear and sublinear encoding for brain-inspired computing.
Area of Science:
- Neuromorphic Engineering
- Materials Science
- Computer Vision
Background:
- Neuromorphic vision sensors are crucial for brain-inspired spiking neural networks.
- Adaptive sensitivity across wide light intensity ranges remains a significant challenge.
Purpose of the Study:
- To develop a neuromorphic vision sensor with enhanced adaptive sensitivity.
- To overcome limitations in dynamic range for light intensity encoding.
Main Methods:
- Utilized a one-transistor-one-memristor pixel structure.
- Integrated plasmonic volatile Ag/hBN/Au memristors for superlinear encoding.
- Employed MoS2 synaptic photodetectors and Ag/hBN/Au memristor neurons for sublinear encoding.
Main Results:
- Achieved high encoding sensitivity over a broad light intensity range by fusing complementary superlinear and sublinear encoding.
- Demonstrated high time-to-first-spike (TTFS) and rate encoding sensitivity in both high-brightness (superlinear) and dim light (sublinear) conditions.
- Successfully performed high-quality imaging, ice/land segmentation, and thickness prediction in polar environments.
Conclusions:
- The developed complementary neuromorphic vision sensor exhibits robust performance under challenging lighting conditions.
- This technology advances hardware for spiking neural networks by enabling adaptive sensitivity.
- The sensor shows potential for real-world applications requiring dynamic range imaging.
Related Concept Videos
01:26Visual System
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
01:24Vision
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
01:20Parallel Processing
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
01:32The Retina
The retina is a layer of nervous tissue at the back of the eye that transduces light into neural signals. This process, called phototransduction, is carried out by rod and cone photoreceptor cells in the back of the retina.
01:22Photoreceptors and Visual Pathways
At the molecular level, visual signals trigger transformations in photopigment molecules, resulting in changes in the photoreceptor cell's membrane potential. The photon's energy level is denoted by its wavelength, with each specific wavelength of visible light associated with a distinct color. The spectral range of visible light, classified as electromagnetic radiation, spans from 380 to 720 nm. Electromagnetic radiation wavelengths exceeding 720 nm fall under the infrared category, whereas...
01:15Insensitive Nuclei Enhanced by Polarization Transfer (INEPT)
Insensitive Nuclei Enhanced by Polarization Transfer (INEPT) is an advanced Nuclear Magnetic Resonance (NMR) technique specifically designed to detect and enhance the signals of low-abundance nuclei, such as carbon-13 and nitrogen-15, in small molecules. The fundamental principle behind INEPT is the transfer of polarization from a more abundant and highly polarizable nucleus, typically hydrogen-1, to the low-abundance nucleus of interest. This process effectively boosts the NMR signal of the...