网络属性决定神经网络的性能.
Chunheng Jiang1,2, Zhenhan Huang1,2, Tejaswini Pedapati3
1Network Science and Technology Center, Rensselaer Polytechnic Institute, Troy, NY, USA.
Nature communications
|July 8, 2024
概括
研究人员使用网络科学开发了一个数学框架来理解人工神经网络. 一个新的神经容量指标预测了模型概括能力,从早期训练数据中进行有效的模型选择.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 网络科学 网络科学
背景情况:
- 人工神经网络 (ANN) 在现代技术中至关重要,但缺乏系统的理解.
- 分析ANN的当前挑战源于复杂的配置和数据依赖架构.
研究的目的:
- 开发一个分析ANN机制的数学框架.
- 为预测模型通用化能力引入一种通用度量.
主要方法:
- 开发了一个框架,将ANN性能映射到线图网络特征.
- 使用边缘动态的随机梯度下降微分方程.
- 根据数学框架推导出一个神经容量度量.
主要成果:
- 神经容量指标普遍捕获了概括能力.
- 仅使用早期训练结果可以预测模型性能.
- 在17个ImageNet模型中,在多个数据集和NAS基准中证明了有效性.
结论:
- 神经容量是模型选择的强大指标.
- 与最先进的方法相比,该指标提供了一种更有效的方法.
更多相关视频
09:01A Method for Investigating Age-related Differences in the Functional Connectivity of Cognitive Control Networks Associated with Dimensional Change Card Sort Performance
Published on: May 7, 2014
10.2K
11:18Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
Published on: March 2, 2015
10.3K
相关概念视频
Neuroplasticity
322
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
322
Neural Circuits
1.1K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.1K
Network Function of a Circuit
280
Frequency response analysis in electrical circuits provides vital insights into a circuit's behavior as the frequency of the input signal changes. The transfer function, a mathematical tool, is instrumental in understanding this behavior. It defines the relationship between phasor output and input and comes in four types: voltage gain, current gain, transfer impedance, and transfer admittance. The critical components of the transfer function are the poles and zeros.
280
Neuronal Communication
828
Neurons, the fundamental units of the brain and nervous system, communicate through complex electrochemical signals that underpin all cognitive and bodily functions. This communication is primarily facilitated by a process involving the generation and propagation of an action potential along the axon of the neuron. When the internal electrical charge of a neuron surpasses a certain threshold, an action potential is triggered. This rapid change in voltage travels swiftly along the axon to the...
828
Neural Regulation
39.3K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
39.3K
Circuit Terminology
635
An electrical network is a system composed of interconnected elements, such as resistors, capacitors, inductors, and voltage or current sources. Unlike a circuit, an electrical network does not necessarily form a closed path. In other words, while all circuits can be considered networks due to their interconnected nature, not every network qualifies as a circuit.
A circuit, on the other hand, is also an interconnected system of electrical elements but must contain one or more closed paths.
A circuit, on the other hand, is also an interconnected system of electrical elements but must contain one or more closed paths.
635
