Learning the non-equilibrium dynamics of Brownian movies

Time-lapse microscopy imaging provides direct access to the dynamics of soft and living systems. At mesoscopic scales, such microscopy experiments reveal intrinsic thermal and non-equilibrium fluctuations. These fluctuations, together with measurement noise, pose a challenge for the dynamical analysis of these Brownian movies. Traditionally, methods to analyze such experimental data rely on tracking embedded or endogenous probes. However, it is in general unclear, especially in complex many-body systems, which degrees of freedom are the most informative about their non-equilibrium nature. Here, we introduce an alternative, tracking-free approach that overcomes these difficulties via an unsupervised analysis of the Brownian movie. We develop a dimensional reduction scheme selecting a basis of modes based on dissipation. Subsequently, we learn the non-equilibrium dynamics, thereby estimating the entropy production rate and time-resolved force maps. After benchmarking our method against a minimal model, we illustrate its broader applicability with an example inspired by active biopolymer gels.