Related Experiment Video
Updated: Jun 8, 2026

A Data-Driven Approach to Quantifying Immune States in Sepsis
Published on: February 7, 2025
Some new measures of entropy, useful tools in biocomputing
Abstract:
The basic problem rooted in Information Theory (IT) foundations (Shannon, Bell Syst Tech J 27:379-423 and 623-656, 1948; Volkenstein, Entropy and Information. Series: Progress in Mathematical Physics, 2009) is to reconstruct, as closely as possible, the input signal after observing the received output signal.The Shannon information measure is the only possible one in this context, but it must be clear that it is only valid within the more restricted scope of coding problems that C. E. Shannon himself had seen in his lifetime (Shannon, Bell Syst Tech J 27:379-423 and 623-656, 1948). As pointed out by Alfred Rényi (1961), in his essential paper (Rényi, Proc. of the 4th Berkeley Symposium on Mathematics, Statistics and Probability, 547-561, 1961) on generalized information measures, for other sorts of problems other quantities may serve just as well as measures of information, or even better. This would be supported either by their operational significance or by a set of natural postulates characterizing them, or preferably by both. Thus, the idea of generalized entropies arises in scientific literature.We analyze here some new measures of Entropy, very useful to be applied on Biocomputing (Ulanowicz and Hannon, Proc R Soc Lond B 232:181-192, 1987; Volkenstein, Entropy and Information. Series: Progress in Mathematical Physics, 2009).
Related Concept Videos
Entropy
Entropy
When an ideal gas expands isothermally, the disorder in the gas increases. From the molecular perspective, the gas molecules have more volume to move around in.
Consider an infinitesimal step in the expansion, which...
The Second Law of Thermodynamics
Entropy and the Second Law of Thermodynamics
The relation between entropy and disorder can be illustrated with the example of the phase change of ice to water. In ice, the molecules are located at specific sites giving a solid state, whereas, in a liquid form, these molecules are much freer to move. The molecular arrangement has therefore become more randomized. Although the change in average...
Entropy and the Second Law of Thermodynamics
Variability: Analysis
The range is a simple measure of variability, indicating the difference between the highest and...

