Related Experiment Video
Updated: Jun 1, 2026

Setting Limits on Supersymmetry Using Simplified Models
Published on: November 15, 2013
The Generalized Asymptotic Equipartition Property: Necessary and Sufficient Conditions
1Department of Statistics, Carnegie Mellon University, Pittsburgh, PA 15213 USA ( harrison@stat.cmu.edu ).
Abstract:
Suppose a string X1n=(X1,X2,…,Xn) generated by a memoryless source (X(n))(n≥1) with distribution P is to be compressed with distortion no greater than D ≥ 0, using a memoryless random codebook with distribution Q. The compression performance is determined by the "generalized asymptotic equipartition property" (AEP), which states that the probability of finding a D-close match between X1n and any given codeword Y1n, is approximately 2(-nR(P, Q, D)), where the rate function R(P, Q, D) can be expressed as an infimum of relative entropies. The main purpose here is to remove various restrictive assumptions on the validity of this result that have appeared in the recent literature. Necessary and sufficient conditions for the generalized AEP are provided in the general setting of abstract alphabets and unbounded distortion measures. All possible distortion levels D ≥ 0 are considered; the source (X(n))(n≥1) can be stationary and ergodic; and the codebook distribution can have memory. Moreover, the behavior of the matching probability is precisely characterized, even when the generalized AEP is not valid. Natural characterizations of the rate function R(P, Q, D) are established under equally general conditions.
Related Concept Videos
Hardy-Weinberg Principle
Second Uniqueness Theorem
In contrast, consider that the electric field is non-unique and apply Gauss's law in divergence form in the region between the conductors and the integral form to the surface...
Fundamental Theorem of Algebra
Central Limit Theorem
The sample size, n, that...
Expected Frequencies in Goodness-of-Fit Tests
Geometric Sequences
