预传感器计算与紧的多层光学神经网络
Zheng Huang1,2, Wanxin Shi1,2, Shukai Wu1,2
1Department of Electronic Engineering, Tsinghua University, Beijing 100084, China.
Science advances
|July 26, 2024
概括
一个新的紧的,被动的多层光学神经网络 (MONN) 可实现高效的前传感器计算. 这项创新大大降低了移动视觉应用的尺寸和功耗.
科学领域:
- 光学和光子学 在光学和光子学.
- 人工智能的人工智能
- 计算机工程 计算机工程
背景情况:
- 将计算靠近传感器解决了速度,功率和数据存储方面的瓶.
- 光学神经网络 (ONN) 提供了广泛的前传感器处理能力.
- 当前的ONN在非线性,激光依赖性,实用性和可扩展性方面面临限制.
研究的目的:
- 提出一个紧且被动的多层光学神经网络 (MONN).
- 克服现有的ONN在实际前传感器计算方面的局限性.
- 为了实现小型化,低功耗的移动视觉系统.
主要方法:
- 设计了被动面具和量子点膜,用于不连贯的光.
- 整合了两个卷积层,并插入了一个非线性层.
- 实现了5毫米的紧光学长度.
主要成果:
- 与线性单层ONN相比,MONN在视觉任务上表现出更高的性能.
- 卸载了高达95%的计算密集型操作,从电子到光学.
- 与基于最先进的镜头的ONN相比,实现了显著更小的足迹.
结论:
- 拟议的MONN为前传感器计算提供了一个实用,小型化和低功耗的解决方案.
- 这项工作引入了移动视觉系统的新范式.
- MONN将光学神经网络领域推向现实世界的应用.
相关概念视频
Parallel Processing
149
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
149
Visual System
563
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
563
Vision
53.1K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.1K


