Related Experiment Video
Updated: Jun 6, 2026

Efficiently Recording the Eye-Hand Coordination to Incoordination Spectrum
Published on: March 21, 2019
Markerless 3D hand tracking for analysis of pediatric eye-hand coordination
Anjali Rajkumar1, Rajvardhan Gadde1,2, Mahya Beheshti1,3
1Department of Rehabilitation Medicine, NYU Langone Health, 244 E38th St., New York, NY 10016, USA.
Insights
This study presents a markerless 3D hand tracking method for assessing pediatric eye-hand coordination during dexterity tasks. The system enables precise kinematic analysis for children with neurological conditions, improving diagnostic capabilities.
Area of Science:
- Biomedical Engineering
- Neuroscience
- Pediatric Rehabilitation
Background:
- Accurate measurement of pediatric eye-hand coordination (EHC) is crucial for diagnosing neurological conditions.
- Existing methods like marker-based motion capture and instrumented gloves are often impractical for children, hindering clinical research and assessment.
Purpose of the Study:
- To adapt the Anipose markerless 3D pose estimation framework for precise, synchronized 3D hand kinematics and eye tracking during the Nine-Hole Peg Test (9HPT) in pediatric populations.
- To develop a practical, non-invasive tool for quantifying EHC in children with brain injuries or neurodegenerative diseases.
Main Methods:
- Utilized multi-camera video acquisition and a markerless 3D pose estimation framework (Anipose).
- Integrated task-specific neural network training optimized for fine finger movements and diverse pediatric hand sizes during the 9HPT.
- Configured camera geometry to minimize occlusion and maintain hand landmark visibility, enabling synchronized eye tracking.
Main Results:
- Achieved low pixel error and stable 3D reconstruction of hand kinematics using confidence-based thresholding.
- The validated workflow generates synchronized 2D/3D visualizations, spatial coordinates, and confidence metrics without requiring wearable sensors.
- Demonstrated feasibility for precise quantification of hand movements during the 9HPT in children.
Conclusions:
- This markerless approach enhances the applicability of EHC research in pediatric clinical settings.
- Facilitates the development of more precise diagnostic assessments and targeted neurorehabilitation strategies for children with neurological injuries.
- Provides a foundation for objective, quantitative evaluation of fine motor skills in pediatric populations.
Abstract:
Precise quantification of eye-hand coordination (EHC) during pediatric dexterity tasks is limited by the lack of practical, high-resolution hand tracking methods suitable for children with brain injury or neurodegenerative disease. Traditional marker-based motion capture systems and instrumented gloves can interfere with natural grasp patterns and are often difficult to implement in clinical pediatric settings. We describe an adaptation of the Anipose markerless 3D pose estimation framework to enable synchronized three-dimensional hand kinematics and eye tracking during the Nine-Hole Peg Test (9HPT). The method integrates multi-camera video acquisition with task-specific neural network training optimized to detect fine finger movements across diverse pediatric hand sizes and grasp configurations. Camera placement and recording geometry were configured to reduce occlusion during peg manipulation and maintain multi-view visibility of hand landmarks. Model validation demonstrated low pixel error and stable three-dimensional reconstruction following confidence-based thresholding. The resulting workflow generates synchronized 2D and 3D visualizations, spatial coordinate outputs, reprojection-error metrics, and landmark confidence scores without requiring wearable sensors. This approach broadens the applicability of eye-hand coordination research within pediatric clinical populations and facilitates the development of more precise, quantitatively informed diagnostic assessments and targeted neurorehabilitation strategies for children with neurologic injury. • Markerless multi-camera 3D reconstruction of pediatric hand kinematics during the 9HPT • Integration of synchronized eye tracking and task-specific neural network training • Output of validated 3D coordinates, confidence metrics, and visualization files suitable for clinical research.
