Alternative Entropy Measures and Generalized Khinchin-Shannon Inequalities
Rubem P Mondaini1, Simão C de Albuquerque Neto1
1COPPE, Centre of Technology, Federal University of Rio de Janeiro, Rio de Janeiro 21941-901, Brazil.
Abstract:
The Khinchin-Shannon generalized inequalities for entropy measures in Information Theory, are a paradigm which can be used to test the Synergy of the distributions of probabilities of occurrence in physical systems. The rich algebraic structure associated with the introduction of escort probabilities seems to be essential for deriving these inequalities for the two-parameter Sharma-Mittal set of entropy measures. We also emphasize the derivation of these inequalities for the special cases of one-parameter Havrda-Charvat's, Rényi's and Landsberg-Vedral's entropy measures.
Related Concept Videos
Entropy and the Second Law of Thermodynamics
The relation between entropy and disorder can be illustrated with the example of the phase change of ice to water. In ice, the molecules are located at specific sites giving a solid state, whereas, in a liquid form, these molecules are much freer to move. The molecular arrangement has therefore become more randomized. Although the change in average...
Entropy
The Second Law of Thermodynamics
Introduction to Test of Independence
The test statistic for a test of independence is similar to that of a goodness-of-fit test:
Second Law of Thermodynamics
Entropy Change in Reversible Processes
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.


