Related Experiment Video
Updated: Oct 4, 2025
06:36
Optrode Array for Simultaneous Optogenetic Modulation and Electrical Neural Recording
Published on: September 1, 2022
3.9K
Mnemonic-opto-synaptic transistor for in-sensor vision system
Joon-Kyu Han1, Young-Woo Chung1,2, Jaeho Sim1
1School of Electrical Engineering, Korea Advanced Institute of Science and Technology, (KAIST) 291 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea.
Scientific Reports
|February 3, 2022
Summary
A novel mnemonic-opto-synaptic transistor (MOST) integrates memory, photodetection, and synaptic functions for efficient in-sensor vision systems. This breakthrough enables faster, more energy-efficient machine vision by processing data directly within the sensor.
Area of Science:
- Materials Science
- Electrical Engineering
- Computer Science
Background:
- Conventional vision systems require separate image sensing and processing units, leading to bottlenecks in speed and energy efficiency.
- Artificial neural networks (ANNs) for machine vision demand significant computational resources and external memory.
- In-sensor processing offers a promising solution to overcome these limitations by integrating sensing and computation.
Purpose of the Study:
- To demonstrate a novel mnemonic-opto-synaptic transistor (MOST) with triple functions for in-sensor vision systems.
- To enable image sensing, memory storage, and synaptic weight updates within a single device.
- To advance machine vision capabilities by reducing reliance on external memory and processing units.
Main Methods:
- Fabrication of a vertical pillar-shaped transistor incorporating a charge trap layer (CTL) for memory functionality.
- Integration of photodetection, memory cell, and synaptic functions into a single MOST device.
- Demonstration of pattern recognition using fabricated MOSTs and software simulations for complex handwritten digits.
Main Results:
- The MOST successfully memorizes photoresponsivity as synaptic weights, enabling tunable light sensing.
- In-sensor processing was achieved, performing image sensing and signal processing simultaneously within the sensor.
- Enhanced speed and energy efficiency were observed compared to conventional vision systems due to on-sensor data preprocessing.
- Successful recognition of simple patterns and complex handwritten digits (MNIST) was demonstrated.
Conclusions:
- The developed MOST represents a significant advancement for in-sensor vision systems, integrating multiple crucial functions.
- This technology facilitates efficient machine vision by enabling on-sensor data processing, reducing the need for external memory.
- The MOST architecture holds potential for developing faster, more energy-efficient artificial intelligence hardware.
Related Concept Videos
01:26Visual System
781
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
781
01:22Photoreceptors and Visual Pathways
6.7K
At the molecular level, visual signals trigger transformations in photopigment molecules, resulting in changes in the photoreceptor cell's membrane potential. The photon's energy level is denoted by its wavelength, with each specific wavelength of visible light associated with a distinct color. The spectral range of visible light, classified as electromagnetic radiation, spans from 380 to 720 nm. Electromagnetic radiation wavelengths exceeding 720 nm fall under the infrared category,...
6.7K
01:22Bipolar Junction Transistor
992
Bipolar Junction Transistors (BJTs) are essential elements in electronic circuits, playing a crucial role in the functionality of amplifiers, memories, and microprocessors. These transistors can be designed as NPN or PNP based on their doping patterns. They consist of three layers: the emitter, base, and collector. The configuration of these layers and their respective doping levels—with N-type or P-type impurities—define the transistor's type and its operational...
992
01:24Vision
55.8K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
55.8K
01:25MOS Capacitor
1.0K
A Metal-Oxide-Semiconductor (MOS) capacitor is a fundamental structure used extensively in semiconductor device technology, particularly in the fabrication of integrated circuits and MOSFETs (metal-oxide-semiconductor field-effect transistors). The MOS capacitor consists of three layers: a metal gate, a dielectric oxide, and a semiconductor substrate.
The metal gate is typically made from highly conductive materials such as aluminum or polysilicon. Beneath the metal gate lies a thin layer of...
The metal gate is typically made from highly conductive materials such as aluminum or polysilicon. Beneath the metal gate lies a thin layer of...
1.0K
01:28Electrical Synapses
9.2K
Electrical synapses found in all nervous systems play important and unique roles. In these synapses, the presynaptic and postsynaptic membranes are very close together (3.5 nm) and are actually physically connected by channel proteins forming gap junctions.
Gap junctions allow the current to pass directly from one cell to the next. In contrast, in the chemical synapse, the neurotransmitters carry the information through the synaptic cleft from one neuron to the next. They consist of two...
Gap junctions allow the current to pass directly from one cell to the next. In contrast, in the chemical synapse, the neurotransmitters carry the information through the synaptic cleft from one neuron to the next. They consist of two...
9.2K