Related Experiment Videos
Hybrid CNN-Transformer Framework for Automated Detection of Developmental Coordination Disorder from Motion Imaging
Khaled Mahmoud Heba1,2,3, Abbas Hassan Abbas Atya2,4, Noor Hazim Saleh Alrawashdeh5
1Department of Architecture, College of Engineering and Information Technology, Onaizah Colleges, Onaizah 56447, Saudi Arabia.
Abstract:
Hybrid CNN-Transformer (HCT) synthesis for automated neurodevelopmental diagnostics is an effective approach to constructing intelligent detection systems that are not merely oriented toward feature classification but primarily toward solving spatiotemporal pattern recognition problems in motor disorder assessment. In neurodevelopmental diagnostics, existing automated methods rely on fixed, single-model architectures that process spatial or temporal motion features independently, failing to adapt to the heterogeneous motor irregularities characteristic of developmental coordination disorder and degrading detection sensitivity and generalization across diverse patient populations. There is therefore a pressing need for models capable of simultaneously capturing intra-frame spatial coordination patterns and inter-frame temporal movement dependencies against interrelated diagnostic criteria including accuracy, sensitivity, and motor irregularity specificity. To address this challenge, this paper proposes HCT, a novel framework that integrates ResNet-based spatial feature extraction from optical flow maps and pose estimation skeletons with multi-head self-attention Transformer encoding for modeling long-range temporal dependencies across multi-frame motion sequences. Unlike conventional single-stream approaches, where spatial and temporal processing remain confined to independent architectures, HCT decouples spatiotemporal feature learning through a cross-modal fusion pipeline, constructing a unified discriminative architecture that captures motor coordination dependencies between motion imaging inputs and multiple diagnostic criteria simultaneously. The convolutional encoder generates diverse joint displacement features, which are consolidated through cross-modal attention fusion into a robust, unified embedding with enhanced generalization and resilience to inter-individual motor variability. Integration within neurodevelopmental assessment frameworks facilitates reliable developmental coordination disorder classification, motor irregularity prediction, and interpretable diagnostic decision support, advancing the accuracy, flexibility, and clinical validity of intelligent motor disorder diagnostic systems.