零散编码的变化自动编码器
Victor Geadah1, Gabriel Barello2, Daniel Greenidge3
1Program in Applied and Computational Mathematics, Princeton University, Princeton, NJ 08544, U.S.A. victor.geadah@princeton.edu.
Neural computation
|October 9, 2024
概括
我们介绍了稀疏编码变异自动编码器 (SVAE),这是有效的视觉处理的新型模型. 这种深度学习方法改善了大脑编码自然图像的方式,超过了现有的方法.
科学领域:
- 计算神经科学是一种神经科学.
- 计算机视觉 计算机视觉
- 机器学习 机器学习
背景情况:
- 稀缺编码模型有效地使用过于完整的字典来表示视觉刺激.
- 传统的稀疏编码模型在神经响应计算和拟合方面面临局限性,原因是反复的动态和近似推理.
研究的目的:
- 引入一个新的Sparse编码变量自编码器 (SVAE) 框架.
- 通过结合基于深度神经网络的识别模型来解决以前稀疏编码模型的局限性.
主要方法:
- 通过使用概率识别模型来增强稀疏编码来开发SVAE.
- 利用深度神经网络从图像补丁到神经活动进行前映射.
- 采用变异推断和最大化证据下限 (ELBO) 模型拟合.
主要成果:
- 与以前的装配方法相比,SVAE在自然图像数据上的测试性能优越.
- 识别网络捕获了与早期视觉通路神经元一致的非线性响应特性.
- 与标准VAE的关键差异包括过于完整的隐性表示,稀疏/重尾的 priors 和线性解码器.
结论:
- SVAE为稀疏编码提供了一个神经可信和计算高效的方法.
- 该框架提供了一种原则方法,用于将稀疏编码模型与数据相匹配.
- 该SVAE推进了我们对神经系统中高效视觉信息处理的理解.
相关概念视频
Variance
9.3K
The deviations show how spread out the data are about the mean. A positive deviation occurs when the data value exceeds the mean, whereas a negative deviation occurs when the data value is less than the mean. If the deviations are added, the sum is always zero. So one cannot simply add the deviations to get the data spread. By squaring the deviations, the numbers are made positive; thus, their sum will also be positive.
The standard deviation measures the spread in the same units as the...
The standard deviation measures the spread in the same units as the...
9.3K
Encoding
134
Information enters the brain through encoding, which is the input of information into the memory system. Once sensory information is received from the environment, the brain labels or codes it. The information is then organized with similar information and connected to existing concepts. Encoding occurs through automatic processing and effortful processing.
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
134
Variability: Analysis
131
Measures of variability are statistical metrics that reveal the dispersion pattern within a dataset. They are pivotal in biostatistics, providing insights into the heterogeneity within health and biological data. Variability signifies the degree to which data points diverge from one another, helping researchers understand the potential range of values and associated uncertainty within the data.
The range is a simple measure of variability, indicating the difference between the highest and...
The range is a simple measure of variability, indicating the difference between the highest and...
131
Vector Algebra: Method of Components
13.8K
It is cumbersome to find the magnitudes of vectors using the parallelogram rule or using the graphical method to perform mathematical operations like addition, subtraction, and multiplication. There are two ways to circumvent this algebraic complexity. One way is to draw the vectors to scale, as in navigation, and read approximate vector lengths and angles (directions) from the graphs. The other way is to use the method of components.
In many applications, the magnitudes and directions of...
In many applications, the magnitudes and directions of...
13.8K
Multi-input and Multi-variable systems
100
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
100
Coefficient of Variation
3.7K
The coefficient of variation measures the dispersion of the data points or distribution around the mean. Using the coefficient of variation, we can compare two data series with drastically different means or different units of measurement. The coefficient of variation for a sample and a population is expressed as a percentage of the ratio of standard deviation to the mean.
The coefficient of variation is a practical statistical tool in finance. It allows investors to assess the volatility or...
The coefficient of variation is a practical statistical tool in finance. It allows investors to assess the volatility or...
3.7K


