Related Experiment Videos
On the Algorithm Complexity of Generating Discrete Uniform Distribution from a Biased Coin
Mengqi Zhang1, Guangqiang Teng2, Xiaoyu Lei3
1School of Economics, Peking University, Beijing 100871, China.
Entropy (Basel, Switzerland)
|July 28, 2026
Summary
This paper analytically proves Lei's Algorithm A3 can generate uniform random numbers from a biased source. It also bounds the algorithm's runtime and simulation cost for practical applications.
Area of Science:
- Information Theory
- Computer Science Theory
- Probability Theory
Background:
- Generating uniformly distributed random numbers is crucial for many computational tasks.
- Biased Bernoulli sources present a challenge for achieving true uniformity.
- Lei's Algorithm A3 (2023) was proposed to address this challenge.
Purpose of the Study:
- To provide a rigorous analytical proof for the uniformity mechanism of Algorithm A3.
- To derive explicit bounds on the algorithm's performance, including acceptance probability and runtime.
- To analyze the conversion of discrete uniform digits to a continuous Uniform(0,1) distribution.
Main Methods:
- Fourier analysis utilizing roots of unity for coefficient extraction.
- Derivation of acceptance-probability and expected-runtime bounds.
- Rigorous treatment of composite moduli.
- Base-n expansion for continuous uniform distribution simulation.
Main Results:
- A Fourier-analytic proof confirms the uniformity of Algorithm A3.
- Explicit bounds for acceptance probability and expected runtime are derived.
- The method for generating a continuous Uniform(0,1) distribution is demonstrated.
- The computational cost of finite-digit simulation is quantified.
Conclusions:
- Algorithm A3 provides an exact discrete uniform distribution from a biased Bernoulli source.
- The analytical bounds offer insights into the algorithm's efficiency and practical feasibility.
- The proposed method enables the simulation of continuous uniform distributions with quantifiable costs.
Related Concept Videos
Bias
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Uniform Distribution
The uniform distribution is a continuous probability distribution of events with an equal probability of occurrence. This distribution is rectangular.Two essential properties of this distribution are The area under the rectangular shape equals 1. There is a correspondence between the probability of an event and the area under the curve.Further, the mean and standard deviation of the uniform distribution can be calculated when the lower and upper cut-offs, denoted as a and b,...
Binomial Probability Distribution
A binomial distribution is a probability distribution for a procedure with a fixed number of trials, where each trial can have only two outcomes.
The outcomes of a binomial experiment fit a binomial probability distribution. A statistical experiment can be classified as a binomial experiment if the following conditions are met:
There are a fixed number of trials. Think of trials as repetitions of an experiment. The letter n denotes the number of trials.
There are only two possible outcomes,...
The outcomes of a binomial experiment fit a binomial probability distribution. A statistical experiment can be classified as a binomial experiment if the following conditions are met:
There are a fixed number of trials. Think of trials as repetitions of an experiment. The letter n denotes the number of trials.
There are only two possible outcomes,...
Probability Distributions
The probability of a random variable x is the likelihood of its occurrence. A probability distribution represents the probabilities of a random variable using a formula, graph, or table. There are two types of probability distribution– discrete probability distribution and continuous probability distribution.
A discrete probability distribution is a probability distribution of discrete random variables. It can be categorized into binomial probability distribution and Poisson probability...
A discrete probability distribution is a probability distribution of discrete random variables. It can be categorized into binomial probability distribution and Poisson probability...
Sampling Distribution
Given simple random samples of size n from a given population with a measured characteristic such as mean, proportion, or standard deviation for each sample, the probability distribution of all the measured characteristics is called a sampling distribution. How much the statistic varies from one sample to another is known as the sampling variability of a statistic. You typically measure the sampling variability of a statistic by its standard error. The standard error of the mean is an example...
Poisson Probability Distribution
A Poisson probability distribution is a discrete probability distribution. It gives the probability of a number of events occurring in a fixed interval of time or space if these events happen at a known average rate and independently of the time since the last event. For example, a book editor might be interested in the number of words spelled incorrectly in a particular book. It might be that, on average, there are five words spelled incorrectly in 100 pages. The interval is 100 pages.
The...
The...