生物识别数据的信息在具有低连接性的循环神经网络中
David Dominguez-Carreta1, Mario González-Rodríguez2, Francisco B Rodriguez1
1Grupo de Neurocomputación Biológica, Dpto. de Ingeniería Informática, Escuela Politécnica Superior, Universidad Autónoma de Madrid, 28049 Madrid, Spain.
Entropy (Basel, Switzerland)
|November 26, 2025
概括
这项研究揭示了随机循环神经网络的低连接性如何影响存储容量和信息内容. 像连接和噪声这样的网络属性对于在模式检索任务中的性能至关重要.
科学领域:
- 计算神经科学是一种计算神经科学.
- 机器学习理论机器学习理论
背景情况:
- 循环神经网络 (RNN) 是一个强大的计算模型.
- 了解具有有限连接性的RNN的存储容量对于高效的信息处理至关重要.
研究的目的:
- 调查具有低连接性的随机RNNs的存储容量和最大信息含量.
- 分析网络特性 (连接性,突触噪声) 对性能和信息保留的影响.
主要方法:
- 网络属性的理论分析.
- 使用Hebbian学习嵌入特定模式.
- 通过度测量评估信息保留.
- 通过广泛的模拟来补充分析.
主要成果:
- 低连接性RNN的特征性存储容量和信息内容.
- 证明了连接和突触噪声对网络性能的影响.
- 通过与生物识别模式检索 (视网膜图,指纹) 的比较来验证发现.
结论:
- 有限连接的RNN具有特定的限制和模式检索能力.
- 获得的洞察力适用于理解神经网络中复杂,结构化的模式检索.
相关概念视频
Entropy within the Cell
12.6K
A living cell's primary tasks of obtaining, transforming, and using energy to do work may seem simple. However, the second law of thermodynamics explains why these tasks are harder than they appear. None of the energy transfers in the universe are completely efficient. In every energy transfer, some amount of energy is lost in a form that is unusable. In most cases, this form is heat energy. Thermodynamically, heat energy is defined as the energy transferred from one system to another that...
12.6K
Entropy Change in Reversible Processes
3.2K
In the Carnot engine, which achieves the maximum efficiency between two reservoirs of fixed temperatures, the total change in entropy is zero. The observation can be generalized by considering any reversible cyclic process consisting of many Carnot cycles. Thus, it can be stated that the total entropy change of any ideal reversible cycle is zero.
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
3.2K
Neural Circuits
2.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
2.6K
Sequence Networks of Rotating Machines
473
A Y-connected synchronous generator, grounded through a neutral impedance, is designed to produce balanced internal phase voltages with only positive-sequence components. The generator's sequence networks include a source voltage that is exclusively in the positive-sequence network. The sequence components of line-to-ground voltages at the generator terminals illustrate this configuration.
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
473
Entropy and the Second Law of Thermodynamics
4.7K
The second law of thermodynamics can be stated quantitatively using the concept of entropy. Entropy is the measure of disorder of the system.
The relation between entropy and disorder can be illustrated with the example of the phase change of ice to water. In ice, the molecules are located at specific sites giving a solid state, whereas, in a liquid form, these molecules are much freer to move. The molecular arrangement has therefore become more randomized. Although the change in average...
The relation between entropy and disorder can be illustrated with the example of the phase change of ice to water. In ice, the molecules are located at specific sites giving a solid state, whereas, in a liquid form, these molecules are much freer to move. The molecular arrangement has therefore become more randomized. Although the change in average...
4.7K
Protein Networks
4.5K
An organism can have thousands of different proteins, and these proteins must cooperate to ensure the health of an organism. Proteins bind to other proteins and form complexes to carry out their functions. Many proteins interact with multiple other proteins creating a complex network of protein interactions.
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
4.5K


