二元化神经网络的二极管阵列与向量矩阵乘法具有很高的一致性
Yunwoo Shin1, Kyoungah Cho1, Sangsig Kim2
1Department of Electrical Engineering, Korea University, 145 Anam-ro, Seongbuk-gu, Seoul, 02841, Republic of Korea.
Scientific reports
|March 12, 2024
概括
二极管数组使二元化神经网络 (BNN) 的有效向量矩阵乘法成为可能. 这些二极管提供了的切换和自我校正特性,为紧和可靠的神经形态计算硬件铺平了道路.
科学领域:
- 材料科学 材料科学 材料科学
- 电气工程 电气工程
- 计算机科学 计算机科学
背景情况:
- 二元化神经网络 (BNNs) 提供了计算效率,但需要专门的硬件才能高效运行.
- 传统的BNN硬件实现通常涉及复杂的架构和大量的功耗.
- 开发新的材料和设备结构对于推进神经形态计算至关重要.
研究的目的:
- 调查使用二极管阵列在BNN中执行矢量矩阵乘法 (VMM).
- 评估用于突触应用的p+-n-p-n+二极管的特性.
- 为了证明使用这些二极管阵列实现BNN的可行性.
主要方法:
- 制造具有p+-n-p-n+结构的二极管阵列.
- 介绍二极管的电气性能,包括下值波动和电流比率.
- 使用二极管阵列进行矢量矩阵乘法和矩阵乘积运算的实验演示.
- 对二极管阵列的线性,可靠性和统一性的评估.
主要成果:
- 二极管阵列通过二元化权重和输入实现了VMM.
- 二极管表现出的切换 (下值摆动<1 mV) 和高电流比率 (~10^8).
- 阵列表现出自我纠正功能和高线性 (R平方 = 0.99986).
- 一个2x2二极管阵列成功地执行了矩阵乘积运算,与VMM有很高的一致性.
结论:
- 二极管阵列是实施BNN的一个可行的组件.
- 这些二极管的独特特性使得高效和紧的突触细胞设计成为可能.
- 证明的性能支持了无干扰,无破坏性读取和半永久性数据存储在BNN硬件中的潜力.
相关概念视频
01:08Vector Algebra: Method of Components
13.9K
It is cumbersome to find the magnitudes of vectors using the parallelogram rule or using the graphical method to perform mathematical operations like addition, subtraction, and multiplication. There are two ways to circumvent this algebraic complexity. One way is to draw the vectors to scale, as in navigation, and read approximate vector lengths and angles (directions) from the graphs. The other way is to use the method of components.
In many applications, the magnitudes and directions of...
In many applications, the magnitudes and directions of...
13.9K
01:16Vector Representation of Complex Numbers
122
Complex numbers, represented in Cartesian coordinates, can also be visualized as vectors. These vectors can be expressed in polar form, emphasizing their magnitude and angle. When a complex number is input into a function, the output is another complex number, highlighting the function's zero point from which the vector representation can originate.
Consider a function defined as the product of the complex factors in the numerator divided by the product of the complex factors in the...
Consider a function defined as the product of the complex factors in the numerator divided by the product of the complex factors in the...
122
01:20Vector Operations
1.3K
Vectors are physical quantities that have both magnitude and direction. The vector operations include addition, subtraction, and scalar multiplication.
A vector multiplied by a scalar value is called scalar multiplication. The result obtained is a new vector with a different magnitude. If the scalar is positive, the direction of the vector remains the same, but if it is negative, the direction of the vector is reversed. For example, the product of the mass and velocity yields the momentum.
A vector multiplied by a scalar value is called scalar multiplication. The result obtained is a new vector with a different magnitude. If the scalar is positive, the direction of the vector remains the same, but if it is negative, the direction of the vector is reversed. For example, the product of the mass and velocity yields the momentum.
1.3K
01:10Vector Algebra: Graphical Method
12.1K
Vectors can be multiplied by scalars, added to other vectors, or subtracted from other vectors. The vector sum of two (or more) vectors is called the resultant vector or, for short, the resultant.
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...
12.1K
01:28Cartesian Vector Notation
774
Cartesian vector notation is a valuable tool in mechanical engineering for representing vectors in three-dimensional space, performing vector operations such as determining the gradient, divergence, and curl, and expressing physical quantities such as the displacement, velocity, acceleration, and force. By using Cartesian vector notation, engineers can more easily analyze and solve problems in various areas of mechanical engineering, including dynamics, kinematics, and fluid mechanics. This...
774
01:11Scalar Product (Dot Product)
8.4K
The scalar multiplication of two vectors is known as the scalar or dot product. As the name indicates, the scalar product of two vectors results in a number, that is, a scalar quantity. Scalar products are used to define work and energy relations. For example, the work that a force (a vector) performs on an object while causing its displacement (a vector) is defined as a scalar product of the force vector with the displacement vector.
The scalar product of two vectors is obtained by multiplying...
The scalar product of two vectors is obtained by multiplying...
8.4K