On the Entropy-Based Localization of Inequality in Probability Distributions

Rajeev Rajaram1, Nathan Ritchey1, Brian Castellani2

  • 1Department of Mathematical Sciences, Kent State University, Kent, OH 44242, USA.

Entropy (Basel, Switzerland)
|September 27, 2025
PubMed
Summary

We developed a new method to pinpoint inequality in probability distributions using recursive decomposition. This technique reveals where and how inequality concentrates, offering structural insights into data heterogeneity.

Related Concept Videos

Probability Distributions01:32

Probability Distributions

 The probability of a random variable x  is the likelihood of its occurrence. A probability distribution represents the probabilities of a random variable using a formula, graph, or table. There are two types of probability distribution– discrete probability distribution and continuous probability distribution.
A discrete probability distribution is a probability distribution of discrete random variables. It can be categorized into binomial probability distribution and Poisson...
11.8K
Applications of Integration to Probability Density Functions01:27

Applications of Integration to Probability Density Functions

Continuous probability distributions are used to model random variables that can take on any real value within a specified range. These variables do not take on isolated or countable values but rather exist on a continuum. For example, the height of an individual can be measured with increasing precision—such as 163.5 or 165.25 centimeters—demonstrating that height is a continuous random variable.The behavior of such variables is described using a probability density function (PDF),...
8
Application of Nonlinear Inequalities01:29

Application of Nonlinear Inequalities

A nonlinear inequality describes a comparison involving an expression that curves or behaves more complexly than a straight line. These inequalities often appear in forms that include squares, products, or variables in the denominator.To solve such an inequality, one starts by rewriting it so that zero appears on one side. For example, the inequality:  can be factored as: This form makes it easier to identify the values that cause the expression to equal zero. In this case, the...
214
Probability Histograms01:17

Probability Histograms

A probability histogram is a visual representation of a probability distribution. Similar a typical histogram, the probability histogram consists of contiguous (adjoining) boxes. It has both a horizontal axis and a vertical axis. The horizontal axis is labeled with what the data represents. The vertical axis is labeled with probability. Each rectangular bar in the histogram is 1 unit wide, which suggests that the area under each bar equals the probability, P(x), where x is 1, 2, 3, and so on.
13.2K
Binomial Probability Distribution01:15

Binomial Probability Distribution

A binomial distribution is a probability distribution for a procedure with a fixed number of trials, where each trial can have only two outcomes.
The outcomes of a binomial experiment fit a binomial probability distribution. A statistical experiment can be classified as a binomial experiment if the following conditions are met:
There are a fixed number of trials. Think of trials as repetitions of an experiment. The letter n denotes the number of trials.
There are only two possible outcomes,...
15.3K
Uniform Distribution01:19

Uniform Distribution

The uniform distribution is a continuous probability distribution of events with an equal probability of occurrence. This distribution is rectangular.
Two essential properties of this distribution are
6.0K