一个自我学习的磁性霍普菲尔德神经网络,具有内在的梯度下降适应性
Chang Niu1,2, Huanyu Zhang1,2, Chuanlong Xu1,2
1State Key Laboratory of Surface Physics and Institute for Nanoelectronic Devices and Quantum Computing, Fudan University, Shanghai 200433, China.
概括
研究人员开发了一种自我学习的自旋电子系统,模仿霍普菲尔德神经网络. 这种物理神经网络自主训练使用内在材料特性,减少对外部计算的需求.
科学领域:
- 材料科学 材料科学 材料科学
- 神经科学是一个神经科学.
- 计算机科学 计算机科学
背景情况:
- 物理神经网络 (PNN) 提供节能的人工智能,但面临培训挑战.
- 目前PNN培训严重依赖于外部计算资源.
- 物理自学,使用内在材料特性进行训练,是新兴的解决方案.
研究的目的:
- 为霍普菲尔德神经网络 (HNN) 展示一种能够进行物理自学的自旋系统.
- 通过自主物理过程展示学习规则的内在适应.
- 消除在培训PNN中对外部计算的需求.
主要方法:
- 实施了一个模仿HNN的旋转系统,使用磁纹定义导电矩阵作为可训练重量.
- 应用外部电压输入来推动导电矩阵的演变.
- 通过物理参数的自然演变来证明无监督学习.
主要成果:
- 导电矩阵以梯度下降的方式进化和调整了Oja的学习算法.
- 自学HNN展示了可扩展性.
- 该系统成功地在具有高度相似性的模式上实现了关联记忆.
结论:
- 一个真正的自学物理HNN的spintronic系统被成功演示.
- 通过物质性质进化的学习规则的内在适应消除了外部计算需求.
- "Spintronic"平台为高效,自主,基于材料的培训提供了一个有前途的途径.
相关概念视频
What is an Electrochemical Gradient?
Adenosine triphosphate, or ATP, is considered the primary energy source in cells. However, energy can also be stored in the electrochemical gradient of an ion across the plasma membrane, which is determined by two factors: its chemical and electrical gradients.The chemical gradient relies on differences in the abundance of a substance on the outside versus the inside of a cell and flows from areas of high to low ion concentration. In contrast, the electrical gradient revolves around an ion’s...
Magnetic Vector Potential
In electrostatics, the electric field can be written as the negative gradient of the potential. In magnetostatics, the zero divergence of the magnetic field ensures that the magnetic field can be expressed as the curl of a vector potential. This potential is known as the magnetic vector potential.
Consider an ideal solenoid with n turns per unit length and radius R. If I is the current through the solenoid, the magnetic field inside the solenoid is expressed as the product of vacuum...
Consider an ideal solenoid with n turns per unit length and radius R. If I is the current through the solenoid, the magnetic field inside the solenoid is expressed as the product of vacuum...
Neural Circuits
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Gradient Vectors and Their Applications
Every point on a topographical map corresponds to a particular elevation, so the landscape can be modeled as a surface whose height depends on horizontal position. From any given location, a hiker may face infinitely many directions, but only one direction produces the fastest possible increase in elevation. This unique route is called the direction of steepest ascent, and in multivariable calculus, it is represented by the gradient vector of the elevation function.The gradient vector points...
Significance of the Gradient Vector
A surface defined by a function of two variables can be understood by examining how it changes along specific directions. When one variable is held constant, the surface reduces to a curve that reflects variation in the other variable. For example, fixing one variable and moving parallel to a coordinate axis produces a cross-sectional curve. The slope of this curve at a given point represents how the function changes in that particular direction, providing a measure of local steepness.By...
Gradient Fields
A gradient field is a vector field derived from a scalar field. A scalar field assigns a single numerical value to every point in space, such as temperature, pressure, or electric potential. The gradient field describes how that value changes from point to point. It gives both the direction of the fastest increase and the rate of change in that direction.For a scalar field f(x, y), the gradient is written as\begin{equation*}\nabla f=\left\langle \jfrac{\partial f}{\partial x},\jfrac{\partial...


