用于神经网络的可转移多色光学编码器
Minho Choi1, Jinlin Xiang2, Anna Wirth-Singh3
1Department of Electrical and Computer Engineering, University of Washington, Seattle, 98103, WA, USA. kernel@uw.edu.
Nature communications
|July 2, 2025
概括
本研究介绍了一种用于计算机视觉的光学编码器,它通过在图像捕获过程中执行卷曲来显著降低计算负载. 这种混合方法提高了实时应用程序的效率.
科学领域:
- 计算机视觉 计算机视觉
- 光学工程是指光学工程.
- 人工智能的人工智能
背景情况:
- 人工神经网络 (ANN) 在计算机视觉方面表现出色,但需要大量的计算资源,限制实时性能.
- 对ANN的高计算需求阻碍了在资源有限或时间敏感的应用中广泛采用.
研究的目的:
- 开发一种能够在图像捕获过程中执行初始卷积运算的光学编码器.
- 为了减少计算机视觉系统的计算复杂性和能源消耗.
- 调查混合光学-数字方法的可行性,以提高效率.
主要方法:
- 一个模拟光学编码器被设计为在图像捕获阶段在三个颜色通道同时进行卷积.
- 光学编码器有效地实现了神经网络的初始卷积层.
- 该系统在CIFAR-10数据上进行了训练,并在ImageNet子集 (High-10) 上进行了测试.
主要成果:
- 与传统方法相比,计算操作减少了约24,000倍.
- 在自由空间光学系统中达到~73.2%的最先进的分类精度.
- 经过训练的光学编码器的可转移性已被证明,可转移到不同的数据集 (ImageNet子集) 中,准确度中等.
- 每个对象分类的系统级能源消耗减少了两个以上的数量级.
结论:
- 拟议的光学编码器大大降低了计算机视觉系统的计算负载和能源消耗.
- 混合光学数字系统显示了高效的实时图像处理的巨大潜力.
- 这种方法为更节能,更快速的计算机视觉应用铺平了道路.
相关概念视频
Neural Circuits
1.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.6K
Sequence Networks of Rotating Machines
150
A Y-connected synchronous generator, grounded through a neutral impedance, is designed to produce balanced internal phase voltages with only positive-sequence components. The generator's sequence networks include a source voltage that is exclusively in the positive-sequence network. The sequence components of line-to-ground voltages at the generator terminals illustrate this configuration.
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
150
Multi-input and Multi-variable systems
152
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
152
Neural Regulation
40.3K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
40.3K


