Broadcast Channel Cooperative Gain: An Operational Interpretation of Partial Information Decomposition
Chao Tian1, Shlomo Shamai Shitz2
1Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX 77840, USA.
Abstract:
Partial information decomposition has recently found applications in biological signal processing and machine learning. Despite its impacts, the decomposition was introduced through an informal and heuristic route, and its exact operational meaning is unclear. In this work, we fill this gap by connecting partial information decomposition to the capacity of the broadcast channel, which has been well studied in the information theory literature. We show that the synergistic information in the decomposition can be rigorously interpreted as the cooperative gain, or a lower bound of this gain, on the corresponding broadcast channel. This interpretation can help practitioners to better explain and expand the applications of the partial information decomposition technique.
Related Concept Videos
Extraction: Partition and Distribution Coefficients
For extracting a solute from an aqueous phase into an...
Cable: Problem Solving
Network Function of a Circuit
Gain
Gain:
Suppose Vin is the input and Vout is the output signal to a circuit.
Passive Filters
Low-Pass Filters
Low-pass filters are designed to transmit signals with frequencies lower than the cutoff frequency, ωc, and attenuate those above it. The cutoff...
Properties of Fourier Transform I
In radio broadcasting, multiple audio signals often need to be transmitted simultaneously. The Fourier...


