高效的后端兼容的灵活的基于Si的光学记忆交叉阵列,用于边缘神经形态生理信号处理和生物机器视觉
Dayanand Kumar1, Hanrui Li1, Dhananjay D Kumbhar1
1Smart, Advanced Memory Devices and Applications (SAMA) Laboratory, Electrical and Computer Engineering, Computer Electrical Mathematical Science and Engineering, King Abdullah University of Science and Technology (KAUST), 23955-6900, Thuwal, Saudi Arabia.
Nano-micro letters
|July 8, 2024
概括
这项研究引入了智能边缘设备的新型光电子突触,增强了诸如预测和手势识别等医疗保健应用. 该设备提供超低功耗微调和光触发功能用于神经形态计算.
科学领域:
- 材料科学 材料科学 材料科学
- 神经科学是一个神经科学.
- 计算机工程 计算机工程
背景情况:
- 物联网 (IoT) 推动了对小型化,强大的智能边缘设备的需求.
- 3D集成提供了增强的处理和边缘设备的能源消耗降低.
- 光电子突触是高级神经形态计算的关键组件.
研究的目的:
- 为医疗保健应用展示一个后端兼容的光电子突触.
- 评估设备在基于电脑电图 (EEG) 的预测,基于电肌图 (EMG) 的手势识别和基于电心图 (ECG) 的心律失常检测方面的性能.
- 展示超低功率微调和光触发突触功能的潜力.
主要方法:
- 开发一个后端兼容的光电子突触.
- 在生物医学数据集 (EEG,EMG,ECG) 上应用转移学习方法.
- 5x5光电子突触阵列的制造和测试.
主要成果:
- 使用预训练模型,实现了2.93% (EEG),4.90% (ECG) 和7.92% (EMG) 的分类精度改进.
- 通过光学编程证明了超低功率 (2.8 × 10^-13 J) 的微调.
- 展现出对光敏感的特征,使光触发的突触功能和视觉感知模拟成为可能.
结论:
- 灵活的光电子突触显示了神经形态生理信号处理的巨大潜力.
- 该设备对可穿戴应用中的人工视觉系统充满希望.
- 光电子突触为患者特定的边缘计算需求提供了高效的解决方案.
相关概念视频
01:32The Retina
The retina is a layer of nervous tissue at the back of the eye that transduces light into neural signals. This process, called phototransduction, is carried out by rod and cone photoreceptor cells in the back of the retina.
01:24Vision
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
01:26Visual System
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
01:20Parallel Processing
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...