基于语义记忆的动态神经网络,使用记忆三元CIM和CAM用于2D和3D视觉
Yue Zhang1,2,3, Woyu Zhang4,5,6, Shaocong Wang1,2,3
1Department of Electrical and Electronic Engineering, the University of Hong Kong, Hong Kong, China.
Science advances
|August 14, 2024
概括
这项研究使用memristors引入了一个动态的神经网络,模仿大脑的关联记忆. 这种新的设计大大降低了人工智能任务的计算和能源成本,例如图像和3D点分类.
科学领域:
- 神经科学是一个神经科学.
- 计算机科学 计算机科学
- 材料科学 材料科学 材料科学
背景情况:
- 人类大脑在动态,关联性处理,整合记忆和计算方面表现出色.
- 当前的人工智能 (AI) 模型是静态的,缺乏关联能力,依赖于分离的内存和处理单元.
- 这在生物智能和人工系统之间造成了巨大的差距.
研究的目的:
- 提出一个硬件和软件共同设计的动态神经网络,模仿大脑的关联能力.
- 利用memristor技术进行集成的内存和处理,使数据与过去的经验有效地关联.
- 为了减少人工智能模型的计算和能源开销.
主要方法:
- 开发了一个基于语义记忆的动态神经网络架构,利用memristors.
- 实现了网络和语义内存,使用基于噪声强大的三元记忆器的内存计算 (CIM) 和内容可定位内存 (CAM) 电路.
- 在ResNet和PointNet++模型上验证了使用MNIST和ModelNet数据集进行图像和3D点分类的共同设计.
主要成果:
- 实现了与传统基于软件的AI模型相提并论的分类准确性.
- 显著减少了计算预算:48.1%用于图像分类和15.9%用于3D点分类.
- 报告了大幅节省能源消耗:77.6%的图像分类和93.3%的3D点分类.
结论:
- 提出的基于memristor的硬件和软件联合设计有效地复制了大脑的关联记忆和动态处理.
- 这种方法为更高效和类似大脑的人工智能系统提供了一条途径.
- 这项技术有望减少复杂的人工智能任务的计算和能源需求.
更多相关视频
11:15Automated Visual Cognitive Tasks for Recording Neural Activity Using a Floor Projection Maze
Published on: February 20, 2014
13.1K
09:46MPI CyberMotion Simulator: Implementation of a Novel Motion Simulator to Investigate Multisensory Path Integration in Three Dimensions
Published on: May 10, 2012
12.6K
相关概念视频
Depth Perception and Spatial Vision
612
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
612
Storage
82
A schema is a mental framework that helps individuals organize and interpret information. Schemata, formed from previous experiences, influence how we process new information: how we encode it, the inferences we make, and how we retrieve it. For instance, a schema for what a typical classroom looks like might include desks, a teacher's desk, a whiteboard, and students in such an environment. This expectation helps us quickly understand and navigate new classrooms without needing to analyze...
82
System of Memory
5.5K
Memory is categorized into three major systems: sensory memory, short-term memory (STM), and long-term memory (LTM). These systems differ in their capacity and the duration for which they can hold information. Sensory memory captures raw sensory input from the environment, holding it for just a few seconds or less. For example, on hearing a brief, loud sound, like a car horn honking, the sound seems to linger in the mind for a moment even after it stops. This is an instance of sensory memory...
5.5K
Vision
53.1K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.1K
Visual System
561
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
561
Working Memory
149
Working memory refers to a combination of components, including short-term memory and attention, that allow an individual to hold information temporarily as we perform cognitive tasks. It is an essential cognitive function that enables the execution of complex tasks such as problem-solving, comprehension, and reasoning. Unlike short-term memory, which simply involves the storage of information for a brief period, working memory involves the active manipulation and processing of this...
149
