进化算法作为反向传播的替代方案,用于对生物物理神经网络和神经ODE进行监督训练
ArXiv
|December 4, 2023
概括
用进化算法 (EA) 训练生物物理准确的神经网络可以克服反向传播 (BP) 的局限性. 电子实验室为复杂的神经模型提供了强大的替代方案,推进了大脑电路研究.
科学领域:
- 计算神经科学是一种计算神经科学.
- 人工智能的人工智能是人工智能.
- 生物物理学的生物物理.
背景情况:
- 生物物理准确的神经元模型为大脑电路功能提供了洞察力.
- 传统的神经网络训练方法,如反向传播 (BP) 面临这些复杂模型的挑战.
研究的目的:
- 分析反向传播 (BP) 适用于培养生物物理准确的神经网络的可用性.
- 研究进化算法 (EAs) 作为这些网络的替代培训方法.
主要方法:
- 分析BP稳定性和与刚性,非线性生物物理神经元模型的分歧.
- 渐变估计进化算法 (EA) 的实施和应用.
- 在Morris-Lecar模型和神经普通微分方程 (ODEs) 的循环网络上测试EA.
主要成果:
- 由于模型属性,反向传播 (BP) 对于生物物理准确的神经网络来说是不稳定和分歧的.
- 进化算法 (EAs) 显示出强度,前传效率和更好的参数探索.
- 在BP失败的地方,EA成功地训练网络,包括刺激集成和工作记忆任务.
结论:
- 进化算法 (EAs) 是训练复杂,生物物理详细的神经网络的可行和有效方法.
- 生物物理神经元模型作为评估神经网络训练算法的有价值的基准.
- 这项工作表明了EA在推进计算神经科学和AI研究方面的潜力.
相关概念视频
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
56
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
56
Evolutionary Relationships through Genome Comparisons
5.8K
Genome comparison is one of the excellent ways to interpret the evolutionary relationships between organisms. The basic principle of genome comparison is that if two species share a common feature, it is likely encoded by the DNA sequence conserved between both species. The advent of genome sequencing technologies in the late 20th century enabled scientists to understand the concept of conservation of domains between species and helped them to deduce evolutionary relationships across diverse...
5.8K


