Related Experiment Video
Updated: May 28, 2026

Time-lapse Live Imaging and Quantification of Fast Dendritic Branch Dynamics in Developing Drosophila Neurons
Published on: September 25, 2019
Anatomy of a bit: Information in a time series observation
Ryan G James1, Christopher J Ellison, James P Crutchfield
1Complexity Sciences Center, University of California at Davis, One Shields Avenue, Davis, California 95616, USA. rgjames@ucdavis.edu
Abstract:
Appealing to several multivariate information measures--some familiar, some new here--we analyze the information embedded in discrete-valued stochastic time series. We dissect the uncertainty of a single observation to demonstrate how the measures' asymptotic behavior sheds structural and semantic light on the generating process's internal information dynamics. The measures scale with the length of time window, which captures both intensive (rates of growth) and subextensive components. We provide interpretations for the components, developing explicit relationships between them. We also identify the informational component shared between the past and the future that is not contained in a single observation. The existence of this component directly motivates the notion of a process's effective (internal) states and indicates why one must build models.
Related Concept Videos
Time-Series Graph
Basic Discrete Time Signals
The unit impulse or sample sequence is mathematically expressed as zero for all n values except at n=0, where it is one. The unit impulse sequence, denoted by δ(n), is the first difference of the unit step sequence, while the unit step sequence u(n) is the...
Data: Types and Distribution
Distributions in...
Introduction To Survival Analysis
The primary goal of survival analysis is to estimate survival time—the time until a...
Discrete Fourier Transform
Classification of Signals
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...

