在神经形态硬件上实现的生物接地新皮质计算原体改善视觉变压器性能
Asim Iqbal1, Hassan Mahmood1, Greg J Stuart2,3
1Tibbling Technologies, Seattle, WA 98052-5727.
概括
研究人员创建了一个生物物理现实的脑电路模型,以开发神经启发的AI (NeuroAI). 这种软赢者获取全部 (sWTA) 电路模型改善了人工智能性能和对图像分类等任务的概括性.
科学领域:
- 计算神经科学是一种神经科学.
- 人工智能的人工智能
- 神经科学是一个神经科学.
背景情况:
- 推进神经启发型人工智能 (NeuroAI) 需要理解大脑计算,并将其应用于硬件和深度学习.
- 新皮层的微电路,特别是小鼠初级视觉皮层中的微电路,利用各种内部神经元类别来进行复杂的动态.
研究的目的:
- 用实验上受约束的,生物物理上现实的方法来建模新皮层微电路.
- 调查四个内部神经元类 (Parvalbumin,Somatostatin,血管活性肠,LAMP5) 在实施软赢家获取全部 (sWTA) 电路动力学中的作用.
- 将生物计算与神经形态硬件和深度学习架构构成桥梁.
主要方法:
- 开发了一种基于导电性的小鼠视觉皮层2-3层网络模型,基于体外生理学.
- 实施了竞争-合作模式,以实现sWTA动态,使选择性输入放大和抑制成为可能.
- 将sWTA图案映射到IBM的TrueNorth神经形芯片上,使用增益匹配策略.
- 在视觉变压器架构中集成sWTA电路作为预处理过器.
主要成果:
- 该sWTA电路展示了增强调制,信号恢复和上下文依赖的多稳定性.
- 神经形态实现揭示了细胞类型角色和硬件原始体之间的对应.
- 稀缺的sWTA模块促进了持续的更新状态和工作内存近似值.
- 将sWTA过器嵌入视觉变压器中,可以提高20%的分布外通用化,并减少训练计算.
结论:
- 这项研究为将生物物理接地皮质计算集成到NeuroAI系统中提供了路线图.
- sWTA电路是提高AI性能和效率的关键动机.
- 这项工作展示了将神经科学原理与人工智能结合起来,实现实际进步的潜力.
更多相关视频
07:11Author Spotlight: Insights into Visual Cortex Research Through Wide-View fMRI Mapping
Published on: December 8, 2023
2.3K
07:52Multiscale Investigations of Cortical Processing by Integrating Laminar Polytrodes and Optogenetics with Micro Electrocorticography in Rodents
Published on: May 23, 2025
784
相关概念视频
Neural Circuits
2.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
2.6K
Parallel Processing
632
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
632
Vision
59.3K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
59.3K
Visual System
1.7K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
1.7K
Neuroplasticity
1.6K
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
1.6K
