高性能人工视觉感知和识别,使用增强等离子体的二维材料神经网络.
Tian Zhang1, Xin Guo1,2, Pan Wang1,2
1State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou, 310027, China.
Nature communications
|March 20, 2024
概括
研究人员开发了一个新的人工神经网络 (ANN),使用2D MoS2 / Ag纳米光传感器阵列. 这个集成系统同时感知,预处理和识别图像,克服了当前神经形态视觉芯片中的延迟和功率问题.
科学领域:
- 材料科学 材料科学 材料科学
- 神经科学是一个神经科学.
- 计算机科学 计算机科学
背景情况:
- 神经形态视觉系统对于自动驾驶汽车和机器人技术至关重要.
- 目前的基于的系统由于单独的模块而遭受高延迟和高功耗.
- 光传感器,转换,内存和处理单元之间的数据穿限制了性能.
研究的目的:
- 开发一种新的人工神经网络 (ANN) 架构,用于高效的图像处理.
- 为了克服现有的神经形态视觉芯片的延迟和功耗限制.
- 展示一种能够同时进行图像传感,预处理和识别的设备.
主要方法:
- 制造一个集成的2D MoS2/Ag纳米光电晶体管阵列.
- 在光传感器阵列上实现人工神经网络 (ANN) 架构.
- 评估设备在传感,预处理和图像识别方面的性能.
主要成果:
- 集成设备实现了同时传感,预处理和识别,没有延迟.
- 光电协同效应显著提高了图像识别的效率和准确性.
- 显示出大动态范围 (180 dB),高速 (500 ns) 和超低能耗 (2.4 × 10^-17 J/尖峰).
结论:
- 开发的2D MoS2/Ag纳米光传感器阵列为下一代神经形态视觉提供了一个有前途的解决方案.
- 集成架构最大限度地减少了数据传输,从而大幅提高了速度和能源效率.
- 这项技术对先进的机器视觉应用具有重大潜力.
相关概念视频
01:24Vision
53.2K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.2K
01:24Prosopagnosia
162
Prosopagnosia, also known as face blindness, is the inability to recognize faces. In severe cases, individuals with prosopagnosia may not recognize close family members, including parents and spouses, by their faces. For instance, someone with prosopagnosia might walk past their child in a crowd, only realizing their mistake upon noticing their child's distinctive backpack or favorite jacket. Prosopagnosia specifically impairs facial recognition, while the recognition of other objects or...
162