光子神经形态架构,用于终身学习
Yuan Cheng1,2, Jianing Zhang1,2, Tiankuang Zhou1,2
1Sigma Laboratory, Department of Electronic Engineering, Tsinghua University, Beijing, 100084, China.
Light, science & applications
|February 25, 2024
概括
本研究介绍了一种终身学习光学神经网络 (L2ONN),可以有效地处理多个AI任务而不会忘记. 这种光子计算方法为边缘人工智能系统的效率和可扩展性提供了显著的改进.
科学领域:
- 光子学 是一个光子学.
- 人工智能的人工智能
- 计算机架构 计算机架构
背景情况:
- 传统的电子计算面临着大规模机器学习的能源和扩展限制.
- 光子计算为高效神经形态系统提供了一个有希望的替代方案.
- 现有的光学神经网络在多任务学习中扎着灾难性的遗忘.
研究的目的:
- 为多任务机器智能开发一个可重新配置的终身学习光学神经网络 (L2ONN).
- 解决电子计算和当前光学神经网络的局限性.
- 在边缘实现可扩展和高效的AI.
主要方法:
- 为终身学习光学神经网络进行算法-硬件联合设计.
- 利用稀疏的光子神经元连接和多频谱表示用于适应性学习.
- 在自由空间和芯片架构上实施L2ONN.
主要成果:
- 在光子计算中,L2ONN首次成功避免了灾难性的遗忘.
- 在单一模型中,在几十个不同的任务 (例如视觉,语音,医学诊断) 中表现出多功能技能.
- 实现了比电子神经网络高10倍的效率和比现有的光学神经网络大14倍的容量.
结论:
- L2ONN为光子神经形态系统提出了一个全新的终身学习计划.
- 这种架构可以实现光速效率和前所未有的可扩展性,用于终端/边缘AI.
- L2ONN克服了光学计算多任务学习的关键挑战.
相关概念视频
Neuroplasticity
359
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
359
Long-term Potentiation
55.2K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
55.2K
Ampere-Maxwell's Law: Problem-Solving
630
A parallel-plate capacitor with capacitance C, whose plates have area A and separation distance d, is connected to a resistor R and a battery of voltage V. The current starts to flow at t = 0. What is the displacement current between the capacitor plates at time t? From the properties of the capacitor, what is the corresponding real current?
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of...
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of...
630
Higher Mental Functions of Brain: Learning and Memory
799
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
799
Neural Circuits
1.2K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.2K
Storage
85
A schema is a mental framework that helps individuals organize and interpret information. Schemata, formed from previous experiences, influence how we process new information: how we encode it, the inferences we make, and how we retrieve it. For instance, a schema for what a typical classroom looks like might include desks, a teacher's desk, a whiteboard, and students in such an environment. This expectation helps us quickly understand and navigate new classrooms without needing to analyze...
85


