更多的数据是如何伤害的:下一代水库计算中的不稳定性和规范化
Yuanzhao Zhang1, Edmilson Roque Dos Santos2,3, Huixin Zhang4,5
1Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, New Mexico 87501, USA.
Chaos (Woodbury, N.Y.)
|July 1, 2025
概括
更多的数据可能会降低深度神经网络的性能. 在这项研究中,我们发现过多的数据可以导致数据驱动的动态系统模型的不稳定性,特别是下一代储计算 (NGRC).
科学领域:
- 动态系统 动态系统
- 机器学习 机器学习
- 计算神经科学是一种神经科学.
背景情况:
- 深度神经网络可以在过多的数据下经历性能退化.
- 数据驱动模型越来越多地用于理解复杂的动态系统.
研究的目的:
- 调查下一代储库计算 (NGRC) 中数据诱导的不稳定性现象.
- 用越来越多的数据阐明NGRC性能退化背后的机制.
- 提出减轻NGRC数据诱导不稳定的策略.
主要方法:
- 专注于下一代储计算 (NGRC) 作为学习动态的框架.
- 分析增加训练数据对模型对流程图的表示的影响.
- 研究NGRC稳定性中延迟状态的辅助维度的作用.
- 建议规范化和噪声注入作为缓解策略.
主要成果:
- 增加培训数据,同时改善流程图表的表示,可能导致NGRC中条件不佳的集成者和不稳定性.
- 数据诱导的不稳定性与NGRC中延迟状态所创造的辅助维度有关.
- 增加规范化和谨慎的噪音注入等策略可以减轻这种不稳定性.
结论:
- 适当的规范化对于动态系统的稳定可靠的数据驱动建模至关重要.
- 了解数据大小和模型稳定性之间的权衡对NGRC应用至关重要.
- 这些发现提供了实用方法来提高NGRC模型的稳定性.
更多相关视频
相关概念视频
BIBO stability of continuous and discrete -time systems
526
System stability is a fundamental concept in signal processing, often assessed using convolution. For a system to be considered bounded-input bounded-output (BIBO) stable, any bounded input signal must produce a bounded output signal. A bounded input signal is one where the modulus does not exceed a certain constant at any point in time.
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
526
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
103
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
103
Multimachine Stability
234
Multimachine stability analysis is crucial for understanding the dynamics and stability of power systems with multiple synchronous machines. The objective is to solve the swing equations for a network of M machines connected to an N-bus power system.
In analyzing the system, the nodal equations represent the relationship between bus voltages, machine voltages, and machine currents. The nodal equation is given by:
In analyzing the system, the nodal equations represent the relationship between bus voltages, machine voltages, and machine currents. The nodal equation is given by:
234
Rapidly Varying Flow
145
Rapidly varying flow (RVF) in open channels is characterized by abrupt changes in flow depth over a short distance, with the rate of depth change relative to distance often approaching unity. These flows are inherently complex due to their transient and multi-dimensional nature, making exact analysis difficult. However, approximate solutions using simplified models provide valuable insights into their behavior.Key Features of Rapidly Varying FlowRVF is commonly observed in scenarios involving...
145
Entropy Change in Reversible Processes
2.7K
In the Carnot engine, which achieves the maximum efficiency between two reservoirs of fixed temperatures, the total change in entropy is zero. The observation can be generalized by considering any reversible cyclic process consisting of many Carnot cycles. Thus, it can be stated that the total entropy change of any ideal reversible cycle is zero.
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
2.7K
Propagation of Uncertainty from Random Error
1.1K
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
1.1K


