Shannon's, mutual, conditional and joint entropy information indices: generalization of global indices defined from

Stephen J Barigye1, Yovani Marrero-Ponce, Oscar Martinez Santiago

  • 1Unit of Computer-Aided Molecular Biosilico Discovery and Bioinformatic Research, Faculty of Chemistry-Pharmacy, Central University of Las Villas, Santa Clara, 54830 Villa Clara, Cuba.

Related Concept Videos

Entropy02:39

Entropy

Salt particles that have dissolved in water never spontaneously come back together in solution to reform solid particles. Moreover, a gas that has expanded in a vacuum remains dispersed and never spontaneously reassembles. The unidirectional nature of these phenomena is the result of a thermodynamic state function called entropy (S). Entropy is the measure of the extent to which the energy is dispersed throughout a system, or in other words, it is proportional to the degree of disorder of a...
Entropy01:18

Entropy

The first law of thermodynamics is quantitatively formulated via an equation relating the internal energy of a system, the heat exchanged by it, and the work done on it. A quantitative formulation of the second law of thermodynamics leads to defining a state function, the entropy.
When an ideal gas expands isothermally, the disorder in the gas increases. From the molecular perspective, the gas molecules have more volume to move around in.
Consider an infinitesimal step in the expansion, which...
Law of Rational Indices01:29

Law of Rational Indices

The Law of rational indices is a fundamental principle in the field of crystallography. According to this law, the intercepts of a crystal face along the crystallographic axes (the three-dimensional axes along which a crystal is measured) can be expressed as either equivalent to the unit intercepts (a, b, c) or simple whole number multiples of them. These multiples are typically denoted as na, n'b, and n''c, where n, n', and n'' are simple whole numbers.To illustrate, consider a crystal with...
Entropy Change in Reversible Processes01:10

Entropy Change in Reversible Processes

In the Carnot engine, which achieves the maximum efficiency between two reservoirs of fixed temperatures, the total change in entropy is zero. The observation can be generalized by considering any reversible cyclic process consisting of many Carnot cycles. Thus, it can be stated that the total entropy change of any ideal reversible cycle is zero.
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
Routh-Hurwitz Criterion I01:15

Routh-Hurwitz Criterion I

Consider an electrical power grid, where stability is essential to prevent blackouts. The Routh-Hurwitz criterion is a valuable tool for assessing system stability under varying load conditions or faults. By analyzing the closed-loop transfer function, the Routh-Hurwitz criterion helps determine whether the system remains stable.
To apply the Routh-Hurwitz criterion, a Routh table is constructed. The table's rows are labeled with powers of the complex frequency variable s, starting from the...
The Entropy as a State Function01:14

The Entropy as a State Function

Consider an arbitrary process that moves between two specific states (A and B) in a cyclic manner. This process is reversible and broken down into smaller parts that each follow a Carnot cycle. A Carnot cycle has two isothermal (constant temperature) processes. During these processes, the ratio of the amount of heat transferred to their respective temperature remains constant. The other two processes in the Carnot cycle are also reversible but adiabatic, which means they occur without any heat...