Approaches for Hybrid Coregistration of Marker-Based and Markerless Coordinates Describing Complex Body/Object...

Area of Science:

• Biomechanics
• Computer Vision
• Motion Capture Technology

Background:

• Full-body motion capture is crucial for analyzing human movement.
• Marker-based systems are common, but markerless and hybrid approaches are gaining traction.
• Coregistration of 2D video and 3D marker data, especially without prior spatial knowledge, remains underexplored.

Purpose of the Study:

• To develop and evaluate methods for coregistering 2D video with 3D motion capture data.
• To transform 2D ball coordinates into 3D space and reconstruct hand motion during complex activities like juggling.
• To address challenges posed by occlusions and the absence of marker tracking for certain body parts or objects.

Main Methods:

• Proposed four linear coregistration methods for 2D video and 3D marker data.
• Utilized three-ball cascade juggling as a test case, incorporating arm and wrist marker data.
• Optimized methods based on ball-motion constraints (hold and flight phases) and gravitational physics.

Main Results:

• Minimizing ball-hand error proved suboptimal, distorting ball trajectories.
• The optimal method leveraged gravitational constraints for vertical transformation and ball-hold constraints for lateral transformation.
• Accurate ball flight description and wrist movement reconstruction were achieved.

Conclusions:

• Hybrid motion capture systems can effectively integrate 2D video and 3D marker data.
• Physics-based constraints (gravity, ball dynamics) are vital for accurate motion reconstruction in coregistration.
• The developed methods offer a robust solution for complex motion analysis scenarios with partial occlusion.