强大的神经网络使用随机共振神经元
Egor Manuylovich1, Diego Argüello Ron2, Morteza Kamalian-Kopae2
1Aston Institute of Photonic Technologies, Aston University, Birmingham, UK. e.manuylovich@aston.ac.uk.
Communications engineering
|November 13, 2024
概括
这项研究引入了一种新的以物理为灵感的神经网络,利用随机共振. 这种方法显著减少了神经元数量,并提高了噪声强度,以提高机器学习性能.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算神经科学是一种神经科学.
背景情况:
- 深层人工神经网络提供了先进的功能,但面临着计算复杂性,功耗和信号处理延迟等挑战.
- 模拟神经网络可以降低功耗,但会受到噪声聚合的影响,从而限制其性能.
- 灵感来自物理学的机器学习为克服传统神经网络架构的局限性提供了潜在的解决方案.
研究的目的:
- 提出一种由物理原理启发的新型神经网络架构.
- 利用随机共振作为一个动态的非线性节点来提高网络效率.
- 为了证明所需的神经元的减少和提高对噪声的强度.
主要方法:
- 开发一种新的神经网络模型,将随机共振作为核心组件.
- 评估网络的预测准确性和神经元数量要求.
- 使用训练数据对噪声强度与传统神经网络进行比较分析.
主要成果:
- 拟议的神经网络显著减少了特定预测准确性所需的神经元的数量.
- 与传统网络相比,该网络在培训数据中显示出对噪声的强化稳定性.
- 随机共振有效地作为一个动态的非线性节点,提高网络效率.
结论:
- 使用随机共振的以物理学为灵感的神经网络,为传统的深度学习模型提供了一个有希望的替代方案.
- 这种方法解决了计算复杂性和功耗的关键问题.
- 增强的噪声稳定性使得这些网络适用于有噪声数据环境的应用.
相关概念视频
Neural Circuits
1.1K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.1K
Double Resonance Techniques: Overview
191
Double resonance techniques in Nuclear Magnetic Resonance (NMR) spectroscopy involve the simultaneous application of two different frequencies or radiofrequency pulses to manipulate and observe two distinct nuclear spins. One important application of double resonance is spin decoupling, which selectively suppresses coupling with one type of nucleus while observing the NMR signal from another nucleus, simplifying the spectrum and enhancing resolution.
Spin decoupling is usually achieved by...
Spin decoupling is usually achieved by...
191
Muscle Stimulation Frequency
2.0K
The contraction strength of muscles is regulated by motor neurons, which modulate the frequency of action potentials dispatched to the motor units based on the body's requirements. This process of varying the muscle stimulation frequency allows muscles to contract with a force that is precisely tailored to the needs of the moment, whether lifting a feather or a heavy box.
Wave summation
At low firing rates, motor neurons induce individual twitch contractions in muscle fibers. These twitches...
Wave summation
At low firing rates, motor neurons induce individual twitch contractions in muscle fibers. These twitches...
2.0K
Neural Regulation
39.1K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
39.1K
Parallel Resonance
187
The parallel RLC circuit is an arrangement where the resistor (R), inductor (L), and capacitor (C) are all connected to the same nodes and, as a result, share the same voltage across them. The parallel RLC circuit is analyzed in terms of admittance (Y), which reflects the ease with which current can flow. The admittance is given by:
187


