Markerless 3D hand tracking for analysis of pediatric eye-hand coordination

Anjali Rajkumar1, Rajvardhan Gadde1,2, Mahya Beheshti1,3

  • 1Department of Rehabilitation Medicine, NYU Langone Health, 244 E38th St., New York, NY 10016, USA.

Methodsx
|June 5, 2026
PubMed

Insights

This study presents a markerless 3D hand tracking method for assessing pediatric eye-hand coordination during dexterity tasks. The system enables precise kinematic analysis for children with neurological conditions, improving diagnostic capabilities.

Area of Science:

  • Biomedical Engineering
  • Neuroscience
  • Pediatric Rehabilitation

Background:

  • Accurate measurement of pediatric eye-hand coordination (EHC) is crucial for diagnosing neurological conditions.
  • Existing methods like marker-based motion capture and instrumented gloves are often impractical for children, hindering clinical research and assessment.

Purpose of the Study:

  • To adapt the Anipose markerless 3D pose estimation framework for precise, synchronized 3D hand kinematics and eye tracking during the Nine-Hole Peg Test (9HPT) in pediatric populations.
  • To develop a practical, non-invasive tool for quantifying EHC in children with brain injuries or neurodegenerative diseases.

Main Methods:

  • Utilized multi-camera video acquisition and a markerless 3D pose estimation framework (Anipose).
  • Integrated task-specific neural network training optimized for fine finger movements and diverse pediatric hand sizes during the 9HPT.
  • Configured camera geometry to minimize occlusion and maintain hand landmark visibility, enabling synchronized eye tracking.

Main Results:

  • Achieved low pixel error and stable 3D reconstruction of hand kinematics using confidence-based thresholding.
  • The validated workflow generates synchronized 2D/3D visualizations, spatial coordinates, and confidence metrics without requiring wearable sensors.
  • Demonstrated feasibility for precise quantification of hand movements during the 9HPT in children.

Conclusions:

  • This markerless approach enhances the applicability of EHC research in pediatric clinical settings.
  • Facilitates the development of more precise diagnostic assessments and targeted neurorehabilitation strategies for children with neurological injuries.
  • Provides a foundation for objective, quantitative evaluation of fine motor skills in pediatric populations.

Related Concept Videos