エネルギー効率の高いエッジコンピューティングのためのメミリストとデジタル・コンピューティング・イン・メモリの融合
Tai-Hao Wen1,2, Je-Min Hung2, Wei-Hsing Huang2
1Taiwan Semiconductor Manufacturing Company Limited (TSMC), No. 8, Li-Hsin Rd. 6, Hsinchu Science Park, Hsinchu 300, Taiwan, R.O.C.
Science (New York, N.Y.)
|April 26, 2024
まとめ
この研究は,AIエッジデバイスのための新しいメミリストル-SRAMコンピューティング-イン-メモリ (CIM) 融合スキームを導入します. このアプローチは精度とエネルギー効率を高め,パーソナライズされたAIアプリケーションのためのオンデバイストレーニングを可能にします.
科学分野:
- 材料科学
- コンピュータ工学
- 人工知能
背景:
- AI エッジデバイスは,エネルギー効率と迅速な応答のために,高容量,非揮発性コンピューティングインメモリ (CIM) を要求します.
- 既存のCIMソリューションはトレードオフに直面しています. メモリストルベースのCIMは耐久性と精度が限られており,SRAMベースのCIMは不安定で,大きな面積を必要とします.
研究 の 目的:
- 既存のCIM技術の限界を克服するAIエッジプロセッサを開発する.
- AI エッジコンピューティングの改善のために,メミリストアとSRAM技術の力を活用する.
主な方法:
- 新しいメムリストル-SRAM CIM融合スキームが設計され,実装されました.
- 核融合プロセッサはSRAM CIMの精度とメムリストル CIMのエネルギー効率と密度を統合しています.
- このシステムは,パーソナライズされたAI機能のための適応的なローカルトレーニングをサポートします.
主要な成果:
- 核融合プロセッサは高いCIM容量と392マイクロ秒の短い覚醒応答遅延を達成しました.
- エネルギー効率のピークは 1 ワットあたり 77.64 テラオペレーションです.
- 精度損失が0.5%未満で堅実な精度を示し,AIエッジプロセッサのためのメミリスト技術が製造可能であることを確認しました.
結論:
- メムリストル-SRAM CIM融合スキームは,精度,効率,容量のバランスをとって,AIエッジデバイスに優れたソリューションを提供します.
- この技術は,デバイス上の適応トレーニングを可能にし,パーソナライゼーションとユーザーエクスペリエンスを強化します.
- メムリストア技術は現在製造可能であり,商用AIエッジプロセッサに統合する準備ができています.
関連する概念動画
01:25MOS Capacitor
771
A Metal-Oxide-Semiconductor (MOS) capacitor is a fundamental structure used extensively in semiconductor device technology, particularly in the fabrication of integrated circuits and MOSFETs (metal-oxide-semiconductor field-effect transistors). The MOS capacitor consists of three layers: a metal gate, a dielectric oxide, and a semiconductor substrate.
The metal gate is typically made from highly conductive materials such as aluminum or polysilicon. Beneath the metal gate lies a thin layer of...
The metal gate is typically made from highly conductive materials such as aluminum or polysilicon. Beneath the metal gate lies a thin layer of...
771
00:51Non-ohmic Devices
1.1K
In most substances, the current flow is proportional to the voltage applied to it. A simple relationship between the values of current, voltage, and resistance is known as Ohm's law. Nonohmic devices do not exhibit a linear relationship between voltage and current. One such device is the semiconducting circuit element known as a diode. A diode is a circuit device that allows current flow in only one direction.
Consider a simple circuit consisting of a battery, a diode, and a resistor. A...
Consider a simple circuit consisting of a battery, a diode, and a resistor. A...
1.1K
01:22MOSFET: Enhancement Mode
328
Enhancement-mode MOSFETs are pivotal components in electronics, distinguished by their capacity to act as highly efficient switches. They are part of the larger family of metal-oxide Semiconductor Field-Effect Transistors (MOSFETs). They are available in two types: p-channel and n-channel, each tailored to specific polarity operations.
In their basic form, enhancement-mode MOSFETs are typically non-conductive when the gate-source voltage (Vgs) is zero. This default 'off' state means no...
In their basic form, enhancement-mode MOSFETs are typically non-conductive when the gate-source voltage (Vgs) is zero. This default 'off' state means no...
328
01:24Fast Decoupled and DC Powerflow
191
The fast decoupled power flow method addresses contingencies in power system operations, such as generator outages or transmission line failures. This method provides quick power flow solutions, essential for real-time system adjustments. Fast decoupled power flow algorithms simplify the Jacobian matrix by neglecting certain elements, leading to two sets of decoupled equations:
191
01:22Semiconductors
692
There is variation in the electrical conductivity of materials - metals, semiconductors, and insulators that are showcased with the help of the energy band diagrams.
Metals such as copper (Cu), zinc (Zn), or lead (Pb) have low resistivity and feature conduction bands that are either not fully occupied or overlap with the valence band, making a bandgap non-existent. This allows electrons in the highest energy levels of the valence band to easily transition to the conduction band upon gaining...
Metals such as copper (Cu), zinc (Zn), or lead (Pb) have low resistivity and feature conduction bands that are either not fully occupied or overlap with the valence band, making a bandgap non-existent. This allows electrons in the highest energy levels of the valence band to easily transition to the conduction band upon gaining...
692
01:24Metal-Semiconductor Junctions
347
The contact of metal and semiconductor can lead to the formation of a junction with either Schottky or Ohmic behavior.
Schottky Barriers
Schottky barriers arise when a metal with a work function (Φm) contacts a semiconductor with a different work function (Φs). Initially, electrons transfer until the Fermi levels of the metal and semiconductor align at equilibrium. For instance, if Φm > Φs, the semiconductor Fermi level is higher than the metal's before contact. The...
Schottky Barriers
Schottky barriers arise when a metal with a work function (Φm) contacts a semiconductor with a different work function (Φs). Initially, electrons transfer until the Fermi levels of the metal and semiconductor align at equilibrium. For instance, if Φm > Φs, the semiconductor Fermi level is higher than the metal's before contact. The...
347