V-PCMixer:将基于3D垂直相变内存的模拟内存计算纳入混合器架构
Sejeung Choi1, Sangbum Kim1,2,3
1Department of Materials Science and Engineering, College of Engineering at Seoul National University, 08826, Seoul, Republic of Korea. sangbum.kim@snu.ac.kr.
Nanoscale
|May 27, 2025
概括
我们开发了V-PCMixer,这是一个使用3D垂直相变内存的模拟内存计算架构. 这种高效的设计加速了机器学习模型处理,同时保持了复杂任务的高精度.
科学领域:
- 计算机工程 计算机工程
- 材料科学 材料科学 材料科学
- 人工智能的人工智能
背景情况:
- 模拟内存计算 (AIMC) 通过实现大规模并行计算,为·诺伊曼架构的局限性提供了解决方案.
- 阶段变换存储器 (PCM) 是一个具有高技术成熟度的有前途的非挥发性模拟设备.
- 基于MLP的混合器为变压器架构提供了更简单,高性能的替代方案.
研究的目的:
- 提出V-PCMixer,这是一个高效的AIMC架构,适用于基于MLP的混合器.
- 为了利用3D垂直相变内存 (V-PCM) 实现高面积密度的突触权重.
- 通过将计算流程集成到3D结构中来证明系统技术的共同优化.
主要方法:
- 使用了具有高效制造工艺和交点阵列配置的3D V-PCM设备.
- 采用了改进的蚀刻和沉积技术,以确保低差异和读音噪声.
- 利用3D V-PCM阵列对V-PCMixer的固有矩阵转换能力.
主要成果:
- 在Cifar-10分类中,V-PCMixer架构在Cifar-10分类中获得了约90%的准确性.
- 在将训练模型转换为模拟时,观察到小幅下降3-4%p的精度下降.
- 3D V-PCM 结构有助于降低计算复杂性和负载.
结论:
- V-PCMixer展示了一个可行的和高效的AIMC架构用于基于MLP的混合器.
- 通过3D集成的系统技术协同优化提供了比2D阵列扩展优势.
- 这项工作突出了3D V-PCM在先进AI硬件加速方面的潜力.
相关概念视频
01:17Design Example: Vintage Mixing Console
210
A sound engineer at a music company recently encountered a problem. The output from their newly acquired studio's vintage mixing console was too low for the requirements of modern recording equipment. To rectify this situation, the engineer decided to design an audio pre-amplifier using an operational amplifier (op-amp) to boost the signal level.
The specifications for the pre-amplifier were clear. It needed to amplify the audio signal by a factor of 10, have an input impedance above 10...
The specifications for the pre-amplifier were clear. It needed to amplify the audio signal by a factor of 10, have an input impedance above 10...
210
01:22Chunking and Rehearsal in Sensory Memory
179
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
179
01:20Design Example: Capacitance Multiplier Circuit
730
In integrated circuit technology, a capacitance multiplier is often utilized to produce a larger capacitance value when a small physical capacitance falls short. This is achieved by a circuit that multiplies capacitance values by a factor of up to 1000, such that a 10-pF capacitor can replicate the performance of a 100-nF capacitor.
The circuit illustrated in Figure 1 below incorporates two op-amps, with the first operating as a voltage follower and the second acting as an inverting amplifier.
The circuit illustrated in Figure 1 below incorporates two op-amps, with the first operating as a voltage follower and the second acting as an inverting amplifier.
730
01:23Mnemonic Devices
66
Mnemonic devices are cognitive tools that facilitate memory retention by linking new information to familiar patterns or organizational strategies. These techniques are beneficial for remembering complex or lengthy sets of information by simplifying and structuring them in easily retrievable ways.
Acronyms
Acronyms are created by using the initial letters of a series of words to form a new word or phrase. This approach condenses complex information into a single, memorable entity. For example,...
Acronyms
Acronyms are created by using the initial letters of a series of words to form a new word or phrase. This approach condenses complex information into a single, memorable entity. For example,...
66