Related Experiment Video
Updated: Sep 3, 2025

Applications of EEG Neuroimaging Data: Event-related Potentials, Spectral Power, and Multiscale Entropy
Published on: June 27, 2013
Causal Inference in Time Series in Terms of Rényi Transfer Entropy
Petr Jizba1, Hynek Lavička1, Zlata Tabachová2
1Faculty of Nuclear Sciences and Physical Engineering, Czech Technical University in Prague, Břehová 7, 115 19 Prague, Czech Republic.
This study introduces Rényi
Area of Science:
- Nonlinear time series analysis
- Information theory
- Causal inference
Background:
- Uncovering causal interdependencies in observational data is challenging.
- Traditional methods may not capture nonlinear dynamics or extreme events.
- Information-theoretic measures offer alternative approaches.
Purpose of the Study:
- To investigate Rényi's transfer entropy for quantifying causal interdependencies in bivariate time series.
- To explore the role of Rényi's parameter α in controlling information flow.
- To connect Rényi entropy-based methods with traditional autoregressive approaches.
Main Methods:
- Utilized Rényi's information measure and transfer entropy.
- Proved equivalence between Granger causality and Rényi transfer entropy for Gaussian variables.
- Extended results to α-Gaussian variables.
- Employed the Leonenko et al. entropy estimator.
- Analyzed coupled Rössler systems.
Main Results:
- Rényi's transfer entropy effectively quantifies causal interdependencies, especially for "black swan" events.
- Demonstrated equivalence between Granger causality and Rényi transfer entropy for Gaussian and partially for α-Gaussian variables.
- Identified a synchronization threshold and transient regime in coupled Rössler systems.
- Successfully inferred coupling direction for strengths below the transient regime onset.
Conclusions:
- Rényi's transfer entropy is a potent tool for causal inference in nonlinear time series.
- The parameter α allows fine-tuning information transfer analysis.
- This approach bridges information-theoretic and autoregressive methods for data-driven causality.
- Rényi's transfer entropy provides insights into complex dynamics like synchronization and transient regimes.
More Related Videos
05:59Author Spotlight: Unlocking New Insights in fNIRS Studies - A Novel Framework for Inter-Brain Synchrony Analysis
Published on: October 6, 2023
08:43Application of Granger Causality Analysis of the Directed Functional Connection in Alzheimer's Disease and Mild Cognitive Impairment
Published on: August 7, 2017
Related Concept Videos
Entropy Change in Reversible Processes
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
Entropy
When an ideal gas expands isothermally, the disorder in the gas increases. From the molecular perspective, the gas molecules have more volume to move around in.
Consider an infinitesimal step in the expansion, which...
Causality in Epidemiology
Time-Series Graph
Transfer Function in Control Systems
To derive the transfer function, consider a general nth-order linear time-invariant...
Entropy and the Second Law of Thermodynamics
The relation between entropy and disorder can be illustrated with the example of the phase change of ice to water. In ice, the molecules are located at specific sites giving a solid state, whereas, in a liquid form, these molecules are much freer to move. The molecular arrangement has therefore become more randomized. Although the change in average...