控制过度装备与物理的控制
Sergei V Kozyrev1, Ilya A Lopatin1, Alexander N Pechen1,2
1Steklov Mathematical Institute of Russian Academy of Sciences, Gubkina St. 8, Moscow 119991, Russia.
这项研究用物理和生物学类比解释了机器学习的过拟合. 它展示了动力理论和捕食者-猎物模型如何改善算法稳定性,并减少像GANs这样的模型中的过拟合.
科学领域:
- 理论机器学习理论机器学习
- 计算物理学的计算物理.
- 数学生物学的数学生物学
背景情况:
- 机器学习应用广泛存在,但它们的效率的理论理由,特别是过拟合控制,较少被探索.
- 过度装配,或一般化属性,是开发强大的机器学习模型的关键挑战.
研究的目的:
- 为机器学习中的过拟合控制提供理论解释,使用物理学和生物学中的类比.
- 展示动力学理论和生态模型的概念如何应用于增强机器学习算法.
主要方法:
- 应用了动力学理论中的Eyring公式来分析随机梯度Langevin动力学的过拟合.
- 建立了生成对抗网络 (GAN) 和生物学的掠食者-猎物模型之间的类比.
- 利用算法稳定性和自由能源概念,将广泛的最小值与低的超连接起来.
主要成果:
- 显示Eyring公式提供了一种在随机梯度朗格温动态中过控制的机制,将宽最小与低自由能量和减少过相关联.
- 证明捕食者-猎物类比解释了GAN中广泛的概率最大值的选择,导致过拟合的减少.
结论:
- 物理学和生物学类比为机器学习效率和过拟合控制提供了宝贵的理论见解.
- 这项研究为理解和改进机器学习算法的概括性质提供了一个新的框架.
更多相关视频
09:32Subject-specific Musculoskeletal Model for Studying Bone Strain During Dynamic Motion
Published on: April 11, 2018
10:36Author Spotlight: Optimization of Airflow Velocities in Battery Cooling Systems for Enhanced Thermal Performance and Reduced Energy Consumption
Published on: November 3, 2023
相关概念视频
Conservation of Mass in Fixed, Nondeforming Control Volume
In the case of a sewer pipe, which can be modeled...
Kinematic Equations: Problem Solving
Rigid Body Equilibrium Problems - II
Consider two children sitting on a seesaw, which has negligible mass. The first child has a mass (m1) of 26 kg and sits at point A, which is 1.6 meters (r1) from the pivot point B; the second child has a mass (m2) of 32 kg and sits at point C. How far from the pivot point B should the second child sit (r2) to balance the seesaw?
Time-Domain Interpretation of PD Control
Consider the example of control of motor torque. Initially, a positive...
Rigid Body Equilibrium Problems - I
Conservation of Mass in Moving, Nondeforming Control Volume
In the context of a detention basin, the conservation of mass states that the total mass of water entering the basin must equal the mass leaving the basin plus any accumulation of...
