足够的比最佳的更好,用于训练神经网络
Irina Babayan1, Hazhir Aliahmadi1, Greg van Anders2
1Department of Physics, Engineering Physics, and Astronomy, Queen's University, Kingston ON, K7L 3N6, Canada.
Nature communications
|December 4, 2025
概括
基于神经网络的优化训练可能会被误导,导致过拟合. 一种新的基于物理学的方法叫做火车网络来产生"足够好的"重量,矛盾地超过优化和改进概括.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算神经科学是一种神经科学.
背景情况:
- 基于优化的训练是神经网络的常见范式.
- 这种方法往往导致过拟合,模型学习虚假的相关性.
- 经常需要进行临时修改,这表明了基本的限制.
研究的目的:
- 为了引入一种新的基于物理的训练方法,称为.
- 为了证明蒸可以超越传统的基于优化的培训.
- 挑战神经网络训练中普遍存在的优化范式.
主要方法:
- 模拟训练神经网络通过系统地采样非最佳权重和偏差.
- 这创建了一个组合的模型,充分代表了潜在的现象.
- 信息几何论据被用来支持蒸的理论基础.
主要成果:
- 矛盾的是,化超越了以优化为基础的领先方法.
- 该方法有效地纠正了过度填充的神经网络.
- 与其他过拟合缓解技术相比,化产生了更容易概括的预测.
结论:
- 优化可能不是训练各种神经网络架构的理想范式.
- 模拟提供了一个可行的替代方案,提高模型的概括性和稳定性.
- 对非优化培训算法的进一步研究是有必要的.
相关概念视频
Survival Tree
374
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
374
Neuroplasticity
1.5K
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
1.5K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
264
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
264

