概括
这项研究介绍了代的Poisson变化自编码器 (iP-VAE),这是一种新的反复尖端神经网络模型,将大脑和机器推理统一起来. 在重建和概括方面,iP-VAE表现出卓越的性能,为人工智能提供一种生物学上可信的方法.
科学领域:
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 在生物大脑和人工系统中的推理可以通过优化共享目标来统一,例如证据下限 (ELBO) 或变化自由能量 (F).
- 实现变异推理的精确神经机制在神经科学中仍然是一个开放的问题.
- 现有的模型往往缺乏生物可信性或难以推广.
研究的目的:
- 为了证明在线自然梯度下降在变量的自由能量 (F) 可以产生一个反复的尖端神经网络架构.
- 引入代的波桑变异自编码器 (iP-VAE) 作为变异推理的生物可信模型.
- 评估拟议的iP-VAE模型的经验性表现和生物可信性.
主要方法:
- 根据Poisson假设在变化自由能量上使用在线自然梯度下降的第一个原理,从第一个原则中推导出一个反复的尖端神经网络模型.
- 通过将标准编码器替换为来自自然梯度下降的本地更新,开发了代式Poisson变化自编码器 (iP-VAE).
- 在涉及稀疏性,重建和概括的任务上,经验性地评估了iP-VAE与标准VAE和高斯预测编码模型对比.
主要成果:
- 该iP-VAE模型通过新兴膜电位动力学进行变异推理.
- 该模型通过横向竞争表现出新兴的规范化,并利用硬件效率高的整数尖峰数表示.
- 在稀疏性,重建性和生物可信性方面,ip-VAE优于标准VAE和高斯预测编码模型.
- 与混合代折旧的VAE相比,iP-VAE对分布外输入的概括性更强.
结论:
- 从第一原则推导推理算法可以导致具体的神经网络架构,这些架构既具有生物学可信性,又具有实证效果.
- 该iP-VAE提供了一个有前途的统一框架,用于理解大脑和机器中的推理.
- 这项工作弥合了理论机器学习目标和实际神经实现之间的差距.
更多相关视频
14:38Creating Objects and Object Categories for Studying Perception and Perceptual Learning
Published on: November 2, 2012
11.9K
10:44Inherent Dynamics Visualizer, an Interactive Application for Evaluating and Visualizing Outputs from a Gene Regulatory Network Inference Pipeline
Published on: December 7, 2021
2.3K
相关概念视频
Multi-input and Multi-variable systems
152
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
152
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
104
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
104
Associative Learning
605
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
605
Neural Circuits
1.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.6K
Variability: Analysis
192
Measures of variability are statistical metrics that reveal the dispersion pattern within a dataset. They are pivotal in biostatistics, providing insights into the heterogeneity within health and biological data. Variability signifies the degree to which data points diverge from one another, helping researchers understand the potential range of values and associated uncertainty within the data.
The range is a simple measure of variability, indicating the difference between the highest and...
The range is a simple measure of variability, indicating the difference between the highest and...
192
Observational Learning
321
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
321
