Reducing degeneracy in maximum entropy models of networks
Szabolcs Horvát1, Éva Czabarka2, Zoltán Toroczkai1,3
1Department of Physics and Interdisciplinary Center for Network Science & Applications, University of Notre Dame, Notre Dame, Indiana 46556, USA.
Physical Review Letters
|May 2, 2015
Summary
Exponential random graphs model network properties but face degeneracy issues. A new method transforms density of states functions to ensure log-concavity, solving degeneracy problems in network analysis.
Area of Science:
- Network Science
- Statistical Physics
- Computational Mathematics
Background:
- Exponential random graphs (ERGs) are principled network models based on Jaynes's maximum entropy principle.
- ERGs predict network properties from empirical data but suffer from degeneracy, hindering their predictive power.
Purpose of the Study:
- To identify the cause of degeneracy in exponential random graph models.
- To develop a method for resolving the degeneracy problem in ERGs.
Main Methods:
- Investigated the relationship between degeneracy and the log-concavity of the density of states function.
- Proposed a transformation method to achieve log-concavity by exploiting nonlinear relationships in observables.
- Applied the method to various systems to demonstrate its effectiveness.
Main Results:
- Degeneracy in ERGs arises when the density of states function is not log-concave, often due to nonlinear observable relationships.
- The proposed transformation method successfully renders the density of states function log-concave.
- The method effectively resolves the degeneracy problem for a broad range of systems.
Conclusions:
- The developed method offers a robust solution to the degeneracy problem in exponential random graph modeling.
- This advancement enhances the reliability and applicability of ERGs in network analysis and prediction.
More Related Videos
Related Concept Videos
02:39Entropy
38.2K
Salt particles that have dissolved in water never spontaneously come back together in solution to reform solid particles. Moreover, a gas that has expanded in a vacuum remains dispersed and never spontaneously reassembles. The unidirectional nature of these phenomena is the result of a thermodynamic state function called entropy (S). Entropy is the measure of the extent to which the energy is dispersed throughout a system, or in other words, it is proportional to the degree of disorder of a...
38.2K
01:18Entropy
3.9K
The first law of thermodynamics is quantitatively formulated via an equation relating the internal energy of a system, the heat exchanged by it, and the work done on it. A quantitative formulation of the second law of thermodynamics leads to defining a state function, the entropy.
When an ideal gas expands isothermally, the disorder in the gas increases. From the molecular perspective, the gas molecules have more volume to move around in.
Consider an infinitesimal step in the expansion, which...
When an ideal gas expands isothermally, the disorder in the gas increases. From the molecular perspective, the gas molecules have more volume to move around in.
Consider an infinitesimal step in the expansion, which...
3.9K
01:10Entropy Change in Reversible Processes
3.4K
In the Carnot engine, which achieves the maximum efficiency between two reservoirs of fixed temperatures, the total change in entropy is zero. The observation can be generalized by considering any reversible cyclic process consisting of many Carnot cycles. Thus, it can be stated that the total entropy change of any ideal reversible cycle is zero.
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
3.4K
01:20Entropy and the Second Law of Thermodynamics
5.3K
The second law of thermodynamics can be stated quantitatively using the concept of entropy. Entropy is the measure of disorder of the system.
The relation between entropy and disorder can be illustrated with the example of the phase change of ice to water. In ice, the molecules are located at specific sites giving a solid state, whereas, in a liquid form, these molecules are much freer to move. The molecular arrangement has therefore become more randomized. Although the change in average...
The relation between entropy and disorder can be illustrated with the example of the phase change of ice to water. In ice, the molecules are located at specific sites giving a solid state, whereas, in a liquid form, these molecules are much freer to move. The molecular arrangement has therefore become more randomized. Although the change in average...
5.3K
01:26Entropy and the Second Law of Thermodynamics
318
Consider an isolated system in which a hot object is placed in contact with a cold one. This is an irreversible process that eventually leads both objects to reach the same equilibrium temperature. It is crucial to note that the constituents of any substance exhibit increased disorder at higher temperatures. As a cold substance absorbs heat, its constituents become more disordered. The energy transfer from a hotter object to a cooler one increases the system's disorder or randomness. This...
318
01:29Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
411
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
411