在卷积神经网络中探测脱学诱导的相关变量的结构和功能性质
Xu Pan1, Ruben Coen-Cagli2, Odelia Schwartz3
1Department of Computer Science, University of Miami, Coral Gables, FL 33146, U.S.A. xupan@miami.edu.
Neural computation
|March 8, 2024
概括
失学的神经网络表现出结构化的噪声相关性,类似于大脑. 这种噪声共变率与信号共变率惊人地保持一致,可以降低网络的准确性,从而提供对神经可变性的见解.
科学领域:
- 计算神经科学是一种计算神经科学.
- 人工神经网络的人工神经网络
- 深度学习是一种深度学习.
背景情况:
- 神经可变性影响计算神经科学中的信息编码.
- 深度神经网络,特别是蒙特卡洛脱机,对固定的输入显示可变的响应.
- 试验对试验神经共变性在学网络中的结构和作用仍然未被研究.
研究的目的:
- 调查卷积神经网络中的试验对试验神经共变的结构.
- 确定这种噪声共变在解码精度中的作用.
- 探索这些网络中噪声和信号共变率之间的关系.
主要方法:
- 利用一个卷积神经网络模型,在训练和测试过程中结合掉队.
- 分析了神经元之间的逐试验相关性 (噪声相关性).
- 检查了共变矩阵轴的对齐,并采用了试验混杂程序.
主要成果:
- 在脱落网络中确定了积极和低维的试验逐试验噪声相关性.
- 在特征图中观察到附近神经元之间的较高噪声相关性,反映了视觉皮层的发现.
- 发现噪声共变子空间在不同的图像中共享,并与全球信号共变保持一致.
结论:
- 神经网络中的脱落层引入了结构化的噪声相关性,其属性与生物神经系统相似.
- 噪声和信号共变率的调整表明了降低网络精度的潜在机制.
- 退学网络可以作为神经可变性的计算模型,并提供对大脑信息处理的见解.
相关概念视频
Neural Circuits
1.2K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.2K
Convolution Properties I
149
Convolution computations can be simplified by utilizing their inherent properties.
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
149
Convolution Properties II
199
The important convolution properties include width, area, differentiation, and integration properties.
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
199
Propagation of Uncertainty from Random Error
682
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
682
Variability: Analysis
143
Measures of variability are statistical metrics that reveal the dispersion pattern within a dataset. They are pivotal in biostatistics, providing insights into the heterogeneity within health and biological data. Variability signifies the degree to which data points diverge from one another, helping researchers understand the potential range of values and associated uncertainty within the data.
The range is a simple measure of variability, indicating the difference between the highest and...
The range is a simple measure of variability, indicating the difference between the highest and...
143
Residuals and Least-Squares Property
7.4K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.4K


