视觉运动的并行感知使用光调节记忆矩阵
Xuan Pan1, Jingwen Shi1, Pengfei Wang1
1Institute of Brain-Inspired Intelligence, National Laboratory of Solid State Microstructures, School of Physics, Collaborative Innovation Center of Advanced Microstructures, Nanjing University, Nanjing 210093, China.
Science advances
|September 29, 2023
概括
研究人员开发了一种新的范德瓦尔斯异构结构阵列,用于传感器内并行视觉运动感知. 这一突破使先进的机器视觉系统能够同时编码和处理时空光模式.
科学领域:
- 材料科学 材料科学 材料科学
- 光电学是指光电子产品.
- 人工智能的人工智能
背景情况:
- 对视觉运动的并行感知对于智能机器视觉至关重要.
- 传统的互补金属氧化物半导体 (CMOS) 技术在传感器层面同时编码时间和空间运动信息方面面临挑战.
研究的目的:
- 为了证明在传感器层面对各种运动模式的并行感知.
- 开发一种能够解读多个运动参数的感应器内视觉运动感知器.
主要方法:
- 在范德瓦尔斯 (vdW) 异构结构数组中利用可调节光的内存矩阵.
- 使用可调节门的光导和可调节光的内存矩阵,同时进行时空光模式编码和处理.
- 使用已开发的阵列实现视觉运动感知器.
主要成果:
- vdW异构阵列成功实现了对各种运动模式的并行感知.
- 感知子展示了能够同时解读多个运动参数的能力,包括方向,速度,加速度和角速度.
- 在传感器层面实现了时空光模式的同时编码和处理.
结论:
- 开发的vdW异构阵列为传感器内并行运动感知提供了一个有前途的方法.
- 这项技术为实现先进的智能机器视觉系统铺平了道路.
- 该研究强调了光电子设备在复杂的感官数据处理方面的潜力.
相关概念视频
Parallel Processing
173
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
173
Visual System
613
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
613
Vision
53.5K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.5K
Depth Perception and Spatial Vision
700
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
700
Color Vision
611
Color perception begins in the retina, the light-sensitive layer at the back of the eye. Two main theories explain how colors are seen: the trichromatic theory and the opponent-process theory. The trichromatic theory, proposed by Thomas Young in 1802 and extended by Hermann von Helmholtz in 1852, suggests that color vision is based on three types of cone receptors in the retina. These cones are sensitive to different but overlapping ranges of wavelengths corresponding to red, blue, and green.
611
Perceptual Constancy
429
Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
429


