The Cauchy Distribution in Information Theory.
1Independent Researcher, Princeton, NJ 08540, USA.
Entropy (Basel, Switzerland)
|February 25, 2023
Summary
This study extends information theory beyond Gaussian distributions, revealing analogous results for Cauchy distributions. New concepts like equivalent probability measures and random variable strength are introduced for Cauchy distributions.
Area of Science:
- Information Theory
- Probability Theory
- Statistical Mechanics
Background:
- The Gaussian law is foundational in information theory for analog random variables.
- Existing information theoretic results are predominantly based on Gaussian distributions.
Purpose of the Study:
- To explore information theoretic results for Cauchy distributions.
- To introduce and analyze new concepts relevant to Cauchy distributions.
Main Methods:
- Theoretical analysis of probability measures.
- Introduction of novel concepts: equivalent pairs of probability measures and strength of real-valued random variables.
Main Results:
- Demonstration of information theoretic results analogous to Gaussian counterparts for Cauchy distributions.
- Establishment of the relevance of equivalent pairs and variable strength to Cauchy distributions.
Conclusions:
- Cauchy distributions possess rich information theoretic properties.
- The newly introduced concepts provide valuable tools for analyzing Cauchy distributions.
Related Concept Videos
Probability Distributions
7.7K
The probability of a random variable x is the likelihood of its occurrence. A probability distribution represents the probabilities of a random variable using a formula, graph, or table. There are two types of probability distribution– discrete probability distribution and continuous probability distribution.
A discrete probability distribution is a probability distribution of discrete random variables. It can be categorized into binomial probability distribution and Poisson...
A discrete probability distribution is a probability distribution of discrete random variables. It can be categorized into binomial probability distribution and Poisson...
7.7K
Chi-square Distribution
4.4K
How does one determine if bingo numbers are evenly distributed or if some numbers occurred with a greater frequency? Or if the types of movies people preferred were different across different age groups or if a coffee machine dispensed approximately the same amount of coffee each time. These questions can be addressed by conducting a hypothesis test. One distribution that can be used to find answers to such questions is known as the chi-square distribution. The chi-square distribution has...
4.4K
Uniform Distribution
5.2K
The uniform distribution is a continuous probability distribution of events with an equal probability of occurrence. This distribution is rectangular.
Two essential properties of this distribution are
Two essential properties of this distribution are
5.2K
Normal Distribution
11.8K
The normal, a continuous distribution, is the most important of all the distributions. Its graph is a bell-shaped symmetrical curve, which is observed in almost all disciplines. Some of these include psychology, business, economics, the sciences, nursing, and, of course, mathematics. Some instructors may use the normal distribution to help determine students’ grades. Most IQ scores are normally distributed. Often real-estate prices fit a normal distribution. The normal distribution is...
11.8K
Poisson Probability Distribution
8.4K
A Poisson probability distribution is a discrete probability distribution. It gives the probability of a number of events occurring in a fixed interval of time or space if these events happen at a known average rate and independently of the time since the last event. For example, a book editor might be interested in the number of words spelled incorrectly in a particular book. It might be that, on average, there are five words spelled incorrectly in 100 pages. The interval is 100 pages.
The...
The...
8.4K
Binomial Probability Distribution
11.2K
A binomial distribution is a probability distribution for a procedure with a fixed number of trials, where each trial can have only two outcomes.
The outcomes of a binomial experiment fit a binomial probability distribution. A statistical experiment can be classified as a binomial experiment if the following conditions are met:
There are a fixed number of trials. Think of trials as repetitions of an experiment. The letter n denotes the number of trials.
There are only two possible outcomes,...
The outcomes of a binomial experiment fit a binomial probability distribution. A statistical experiment can be classified as a binomial experiment if the following conditions are met:
There are a fixed number of trials. Think of trials as repetitions of an experiment. The letter n denotes the number of trials.
There are only two possible outcomes,...
11.2K


