Modeling the Heterogeneous Movements of ASD via Fine-Grained Skeleton Representation Learning

As skeletal data can be collected non-invasively while preserving patient privacy, it is widely used in public medical datasets to document patient behavior. Autism Spectrum Disorder (ASD) is characterized by significant behavioral heterogeneity, reflected in the topological structure and dynamic evolution of skeletal movements. This complexity poses substantial challenges for skeleton-based behavioral analysis. Existing methods struggle to effectively utilize behavioral evolution for subject-specific reasoning, leading to suboptimal representations that lack diagnostic relevance for autism. To address this limitation, we propose a Behavioral Evolution-based Edge Reconstruction (BER) Strategy for learning autism-related behavioral representations. By reconstructing a high-granularity adjacency matrix that spans both spatial and temporal dimensions, utilizing dynamic evolution and spatial location information, BERGCN enhances behavioral reasoning. Specifically, we first compute channel-level spatial and temporal edge reconstruction parameters by performing feature compression and targeted convolution operations on the differences between neighboring frames. Based on these, the spatial edge reconstruction module is designed by combining a generic attention map with two personalized attention maps, while the temporal edge reconstruction module is implemented using flexible frame replacement and weighted aggregation. Finally, we investigate both single-modal and multimodal network architectures under various fusion strategies. We evaluate BERGCN on three autism clinical tasks and a benchmark action recognition dataset. Experimental results demonstrate competitive performance, showing improved sensitivity to subject-specific behavioral patterns while maintaining computational efficiency.