相关实验视频
Updated: Jul 26, 2025

Setting Limits on Supersymmetry Using Simplified Models
Published on: November 15, 2013
通过库普曼光谱的稳定不变模型
Takuya Konishi1, Yoshinobu Kawahara1
1Graduate School of Information Science and Technology, Osaka University, 1-5 Yamadaoka, Suita, Osaka, Japan; Center for Advanced Intelligence Project, RIKEN, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, Japan.
稳定不变模型 (SIMs) 为深度神经网络提供了一种新方法,通过汇聚到不变集来扩展深度平衡模型 (DEQs). 该方法使用Koopman和Perron-Frobenius运算符进行增强的学习任务.
科学领域:
- 机器学习 机器学习
- 深度学习 (Deep Learning) 是一种深度学习.
- 动态系统 动态系统
背景情况:
- 重量绑定模型,包括深平衡模型 (DEQs),在神经网络开发中越来越受欢迎.
- DEQs利用权重绑定来表示无限深的网络,但需要代的解决方案,并假定趋同到一个固定点.
研究的目的:
- 介绍稳定不变模型 (SIM) 作为一种新的深度模型类.
- 扩展DEQ的动态,使其趋于更一般的不变集合,而不仅仅是固定点.
- 为深度学习中的稳定动态提供一个新的视角.
主要方法:
- 使用库普曼和佩伦-弗罗贝尼乌斯运算子的光谱来表示模型动态.
- 根据这种光谱表示,推导出稳定不变模型 (SIM) 的两个变体.
- 开发一个可以像标准的前模型一样训练的SIM的实现.
主要成果:
- 库普曼和佩伦-弗罗贝尼乌斯运算符的光谱分析提供了对稳定动态的洞察,接近DEQs.
- 两个不同的SIM变体被衍生和实施.
- 经验实验表明,SIM在各种学习任务中实现了与DEQ相比或优于DEQ的性能.
结论:
- 稳定不变模型 (SIMs) 是深平衡模型 (DEQs) 的有希望的延伸.
- 频谱方法提供了一种新的方法来分析和设计稳定的深度学习动态.
- SIM 显示具有竞争力或改进的性能,表明它们对未来深度学习应用的潜力.
更多相关视频
08:12Author Spotlight: Exploring Light-Driven Chemical Reactions and Energy-Harnessing Devices in Photochemical Research
Published on: February 16, 2024
08:04Excitonic Hamiltonians for Calculating Optical Absorption Spectra and Optoelectronic Properties of Molecular Aggregates and Solids
Published on: May 27, 2020
相关概念视频
Stability of Equilibrium Configuration
A stable equilibrium occurs when a system tends to return to its original position when given a small displacement, and the potential energy is at its minimum. An example of a stable equilibrium is when a cantilever beam is fixed at one end and a weight is attached to the other end. If the weight...
BIBO stability of continuous and discrete -time systems
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation
On...
First Law: Particles in Two-dimensional Equilibrium
Newton's first law tells us about...
Oscillations about an Equilibrium Position
Fermi Level Dynamics
Electron affinity in semiconductors refers to the energy gap between the minimum of its conduction band and the vacuum level and it is a critical parameter in determining how easily a semiconductor can accept additional electrons.
The work...