超适应性神经形态视觉设备中的高阶动态
Jiayi Xu1, Biyi Jiang1,2, Weizhen Wang2
1School of Microelectronics, Southern University of Science and Technology, Shenzhen, China.
Nature nanotechnology
|August 15, 2025
概括
研究人员开发了一种新的神经形态视觉设备,它集成了视网膜和皮质类功能. 这种超适应性设备实现了人工通用视觉智能系统的高效率.
科学领域:
- 神经形态工程的神经形态工程
- 人工智能的人工智能
- 材料科学 材料科学 材料科学
背景情况:
- 目前用于人工通用视觉智能的神经形态硬件因依赖多个组件而面临区域和功率效率的限制.
- 一个关键的挑战是缺乏一个单一的设备整合多样化的神经元动态在光学和电气领域.
研究的目的:
- 报告一个单一的超适应性神经形态视觉设备,能够模仿生物视觉处理.
- 为了展示一个设备,结合了尖端和分级的神经元动态与超低功耗.
主要方法:
- 开发了一种单一的超适应性神经形象视觉设备 (IxTyO1-x-y/CuOx/Pd),具有量身定制的电子特性.
- 使用现场扫描传输电子显微镜和技术计算机辅助设计模拟来阐明实时光电子动态.
- 使用同质的设备阵列构建一个人工通用视觉智能系统.
主要成果:
- 该设备集成了宽带视网膜尖端神经元和非尖端分级神经元,以及皮质突触和神经元动态.
- 实现了高达67.89万亿次每秒每瓦的卓越功率效率.
- 经过证明的面积效率高达每秒每特征大小3.96兆运算 (MOPS/F2).
结论:
- 开发的单个神经形态视觉设备为人工通用视觉智能提供了高效和适应性的解决方案.
- 该设备支持事件驱动和驱动的范式,使多功能认知成像成为可能.
- 这一突破为下一代生物启发的视觉处理系统铺平了道路.
相关概念视频
01:26Visual System
686
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
686
01:20Parallel Processing
227
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
227
01:24Vision
55.3K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
55.3K
01:20Anatomy of the Eyeball
7.6K
The eye is a spherical, hollow structure composed of three tissue layers. The outer layer — the fibrous tunic, comprises the sclera — a white structure — and the cornea, which is transparent. The sclera encompasses some of the ocular surface, most of which is not visible. However, the 'white of the eye' is distinctively visible in humans compared to other species. The cornea, a clear covering at the front of the eye, enables light penetration. The eye's middle...
7.6K