Related Experiment Video
Updated: Jan 9, 2026

Quantified Assessment of Infant's Gross Motor Abilities Using a Multisensor Wearable
Published on: May 17, 2024
Facilitate Robust Early Screening of Cerebral Palsy via General Movements Assessment With Multi-Modality Co-Learning
Insights
CoGMA, a novel AI framework, enhances general movement assessment (GMA) for early cerebral palsy (CP) detection. It uses multimodal data for training, enabling accurate infant neuromotor behavior analysis with skeleton and clinical data alone.
Area of Science:
- Neurology
- Artificial Intelligence
- Infant Development
Background:
- General Movement Assessment (GMA) is crucial for early cerebral palsy (CP) detection in infants.
- Traditional GMA relies on subjective physician judgment, limiting accessibility and scalability.
- Existing AI methods for GMA often lack detailed body information, relying solely on motion skeletons.
Purpose of the Study:
- To introduce CoGMA, a multi-modality co-learning framework for enhanced General Movement Assessment.
- To improve the accuracy and efficiency of neuromotor behavior evaluation in infants.
- To address limitations of traditional GMA and current AI approaches.
Main Methods:
- Developed CoGMA, a novel framework integrating skeleton data, clinical information, RGB video, and text descriptions using a multimodal large language model.
- Employed a co-learning strategy during training to enhance representation learning.
- Achieved efficient and accurate prediction during inference using only skeleton data and clinical information.
Main Results:
- CoGMA demonstrated robust performance in evaluating both writhing and fidgety movement stages in infants.
- The framework excelled in zero-shot evaluation of fidget movements, overcoming limited training sample issues.
- CoGMA significantly enhances GMA methodology for early detection of neuromotor disorders.
Conclusions:
- CoGMA offers a significant advancement in infant neuromotor behavior assessment and early cerebral palsy detection.
- The framework's efficiency and accuracy pave the way for broader clinical application and research.
- InfantAnimator tool developed to facilitate anonymized data sharing and collaborative research.
Abstract:
General movement assessment (GMA) is a non-invasive method used to evaluate neuromotor behavior in infants under six months of age and is considered a reliable tool for the early detection of cerebral palsy (CP). However, traditional GMA relies on the subjective judgment of multiple internationally certified physicians, making it time-consuming and limiting its accessibility for widespread use. Furthermore, artificial intelligence (AI) approaches may overcome these limitations but are usually based on motion skeletons and lack the ability to capture detailed body information. Here, we propose CoGMA (Collaborative General Movements Assessment), a novel multi-modality co-learning framework for GMA. By integrating multimodal large language model as auxiliary network during training, CoGMA incorporates four types of input data-skeleton data, clinical information, RGB video, and text descriptions-to enhance representation learning. During inference, however, CoGMA achieves efficient and accurate prediction using only skeleton data and clinical information. Experimental evaluations indicate that CoGMA demonstrates robust performance across both the writhing and fidgety movement stages, while also excelling in zero-shot evaluation of fidget movement, thereby mitigating the issue of limited training samples in this stage. This framework significantly enhances the GMA methodology and lays the groundwork for future advancements in early detection and research on infant neuromotor behavior. Additionally, to facilitate anonymized data sharing, we introduce InfantAnimator, a tool that generates non-identifiable videos while preserving essential motion features, thereby supporting broader research and collaboration. The code is available at GitHub: https://github.com/wwYinYin/CoGMA.
More Related Videos
07:20Author Spotlight: Repetitive Transcranial Magnetic Stimulation Combined with Movement Observation in Cerebral Palsy
Published on: August 9, 2024
08:26Event-related Potentials During Target-response Tasks to Study Cognitive Processes of Upper Limb Use in Children with Unilateral Cerebral Palsy
Published on: January 11, 2016