极小:最佳模型的统计物理学
David P Carcamo1,2, Nicholas J Weaver1,2, Purushottam D Dixit3,4
1Yale University, Department of Physics, New Haven, Connecticut, USA.
Physical review. E
|January 21, 2026
概括
我们介绍了一个最小的原理,用于在数据建模中选择最佳特征. 这种方法平衡了模型的准确性和复杂性,从而为机器学习和生物网络分析提供了更好的数据压缩.
科学领域:
- 信息理论 信息理论
- 机器学习 机器学习
- 计算生物学 计算生物学
背景情况:
- 模型构建旨在实现最佳的数据压缩,平衡精度和细节.
- 选择相关的特征对于有效的模型构建至关重要.
- 现有的方法仅限于小规模系统.
研究的目的:
- 在数据建模中引入一种最佳特征选择的新原则.
- 为了证明实现最佳数据压缩的最小原理.
- 探索机器学习和生物网络建模中的应用.
主要方法:
- 使用最小描述长度原则.
- 为特征选择推导最小原则.
- 审查现有应用程序并确定限制.
主要成果:
- 最佳特征被确定为在最小模型中最大化的特征.
- 最小的原理为最佳特征选择提供了一个框架.
- 对高维数据的天真实现的局限性.
结论:
- 极小值原理为最佳数据压缩和特征选择提供了一种新的方法.
- 对于高维数据集,需要新的理论和计算方法.
- 这一原则在科学领域具有广泛的适用性.
相关概念视频
Entropy
35.0K
Salt particles that have dissolved in water never spontaneously come back together in solution to reform solid particles. Moreover, a gas that has expanded in a vacuum remains dispersed and never spontaneously reassembles. The unidirectional nature of these phenomena is the result of a thermodynamic state function called entropy (S). Entropy is the measure of the extent to which the energy is dispersed throughout a system, or in other words, it is proportional to the degree of disorder of a...
35.0K
Entropy
3.5K
The first law of thermodynamics is quantitatively formulated via an equation relating the internal energy of a system, the heat exchanged by it, and the work done on it. A quantitative formulation of the second law of thermodynamics leads to defining a state function, the entropy.
When an ideal gas expands isothermally, the disorder in the gas increases. From the molecular perspective, the gas molecules have more volume to move around in.
Consider an infinitesimal step in the expansion, which...
When an ideal gas expands isothermally, the disorder in the gas increases. From the molecular perspective, the gas molecules have more volume to move around in.
Consider an infinitesimal step in the expansion, which...
3.5K
Standard Entropy Change for a Reaction
24.0K
Entropy is a state function, so the standard entropy change for a chemical reaction (ΔS°rxn) can be calculated from the difference in standard entropy between the products and the reactants.
24.0K
Statistical Significance
21.1K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
21.1K
Entropy and Solvation
8.3K
The process of surrounding a solute with solvent is called solvation. It involves evenly distributing the solute within the solvent. The rule of thumb for determining a solvent for a given compound is that like dissolves like. A good solvent has molecular characteristics similar to those of the compound to be dissolved. For example, polar solutions dissolve polar solutes, and apolar solvents dissolve apolar solutes. A polar solvent is a solvent that has a high dielectric constant (ϵ...
8.3K
Entropy within the Cell
12.7K
A living cell's primary tasks of obtaining, transforming, and using energy to do work may seem simple. However, the second law of thermodynamics explains why these tasks are harder than they appear. None of the energy transfers in the universe are completely efficient. In every energy transfer, some amount of energy is lost in a form that is unusable. In most cases, this form is heat energy. Thermodynamically, heat energy is defined as the energy transferred from one system to another that...
12.7K


