Effects of spatiotemporal (dis)continuity on working memory for human movements

Human movements are dynamic and continuous in nature. However, how the spatiotemporal continuity influences working memory for movements is still unclear. Specifically, spatiotemporal continuity of movements may facilitate integrative processing ("integration") and enhance memory performance by optimizing the encoding process, but it may also diminish memory benefits from distinctive processing ("separation"). In this study, we manipulated the continuity state (continuous/discontinuous) (Experiment 1) and its predictability (Experiment 2) of whole-body movement sequences and tested participants' working memory for observed movements with a single-probe recognition task. We formulated potential influence from spatiotemporal (dis)continuity by two opposite forces - integration vs. separation, and demonstrated a conflict between these two processes across space and time. Moreover, we found that the seemingly stimulus-driven perceptual effects from spatiotemporal (dis)continuity might be supported by a prediction-based mechanism, which guided the selection of an optimal processing strategy. Overall, our finding illustrates an interweaving relationship between spatial and temporal processing during action observation and highlights the importance of considering the dynamic and continuous nature of human movements in visual perception and working memory research.