Rényi entropy of zeta urns
Piotr Bialas1, Zdzislaw Burda2, Desmond A Johnston3
1Institute of Applied Computer Science, Jagiellonian University, Ulica Lojasiewicza 11, 30-348 Kraków, Poland.
Abstract:
We calculate analytically the Rényi entropy for the zeta-urn model with a Gibbs measure definition of the microstate probabilities. This allows us to obtain the singularities in the Rényi entropy from those of the thermodynamic potential, which is directly related to the free-energy density of the model. We enumerate the various possible behaviors of the Rényi entropy and its singularities, which depend on both the value of the power law in the zeta urn and the order of the Rényi entropy under consideration.
Related Concept Videos
Wald-Wolfowitz Runs Test II
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and...
Entropy
Entropy and the Second Law of Thermodynamics
The relation between entropy and disorder can be illustrated with the example of the phase change of ice to water. In ice, the molecules are located at specific sites giving a solid state, whereas, in a liquid form, these molecules are much freer to move. The molecular arrangement has therefore become more randomized. Although the change in average...
Third Law of Thermodynamics
z Scores and Unusual Values
This score indicates how far a value is from the mean in terms of standard deviation. For example, if a data value has a z score of +1, the researcher can infer that the particular data value is one standard deviation above the mean. If another data...
Second Law of Thermodynamics


