深度贝叶斯主动学习使用内存计算硬件
Yudeng Lin1, Bin Gao2, Jianshi Tang1
1School of Integrated Circuits, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China.
Nature computational science
|December 23, 2024
概括
这项研究介绍了一种基于memristor的新型内存计算系统,用于高效的深度贝叶斯主动学习 (DBAL). 与传统硬件相比,新方法显著加速了人工智能任务,并减少了能源消耗.
科学领域:
- 人工智能的人工智能
- 材料科学 材料科学 材料科学
- 计算机工程 计算机工程
背景情况:
- 数据标签是人工智能开发中的一个昂贵的瓶.
- 深度贝叶斯主动学习 (DBAL) 提高了标签效率,但需要专门的硬件.
- 传统硬件很难应对DBAL的高带宽和概率计算需求.
研究的目的:
- 用memristor技术为DBAL开发一种高效的现场学习方法.
- 在内存计算 (CIM) 框架中实现DBAL.
- 为了证明基于memristor的随机CIM对AI任务的可行性和优势.
主要方法:
- 提出了一个memristor随机梯度Langevin动力学在现场学习方法.
- 在基于memristor的随机CIM系统上实现内存DBAL.
- 利用memristors固有的随机性来有效地从不确定的数据中学习.
主要成果:
- 通过使用拟议的系统,成功演示了机器人技能学习任务.
- 与传统硬件相比,实现了44%的速度提升.
- 节省了比基于补充金属氧化物半导体 (CMOS) 的实施方式多153倍的能量.
结论:
- 基于memristor的随机CIM可以实现高效的DBAL.
- 提出的方法显著提高了人工智能任务的速度和能源效率.
- 这种方法为硬件密集型AI应用提供了一个有前途的解决方案.
相关概念视频
Associative Learning
288
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
288
Parallel Processing
145
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
145
Machines: Problem Solving II
296
Machines are complex structures consisting of movable, pin-connected multi-force members that work together to transmit forces. Consider a lifting tong carrying a 100 kg load. It comprises movable sections DAF and CBG linked together with member AB.
296
Machines: Problem Solving I
299
A toggle clamp is a mechanical device commonly used for holding and clamping objects in various applications, such as woodworking, metalworking, and assembly operations. Consider a toggle clamp subjected to a force of 200 N at the handle. The vertical clamping force can be calculated, provided the dimensions of the toggle clamp are known.
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
299
Multi-input and Multi-variable systems
96
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
96
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
40
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
40


