Dynamic-Aware video distillation: Adaptive temporal partitioning based on video semantics for edge device

Deep learning model training on edge device is challenged by limited computational power and dataset scale. Dataset distillation (DD) aims to address this challenge by synthesizing a compact, small-scale dataset that yields model performance comparable to the full original data. While DD has achieved notable success on image datasets, existing approaches struggle with video data due to its inherent temporal complexity and varying redundancy across different video semantics. Prior methods assume uniform level of temporal redundancy across all video semantics, which limits their effectiveness. In this work, we propose Adaptive Temporal Partitioning of synthetic videos to account for semantic adaptability and better temporal redundancy reduction. We further propose Dynamic-Aware Video Distillation (DAViD), a reinforcement learning framework that learns an optimal temporal partitioning policy. A teacher-in-the-loop reward function guides the RL agent's policy updates. To our knowledge, this is the first study to adaptively reduce temporal redundancy based on video semantics within the DD domain. Our approach substantially outperforms existing DD techniques, demonstrating significant gains in efficiency and model performance. We believe this work paves way for more efficient, semantics-aware video DD for resource-limited edge device scenarios.