Related Experiment Videos
Furniture-Adaptive Sitting Interaction From Monocular Video
Abstract:
Monocular video provides an accessible source of human motion, but reconstructed body-centric motions do not preserve spatial relationships when transferred to furniture with different geometries. To address this problem for sitting interactions, we propose a furniture-adaptive motion retargeting framework. Our framework predicts interaction importance to represent the spatial relationships between the body-centric motion and the target furniture. We use the predicted pelvis importance to guide furniture adaptation and determine the interaction phase based on the detected sitting onset. To this end, we introduce interaction-guided geometry alignment and phase-aware motion composition, which adapt the motion to the target furniture and integrate interaction-aware key-joint motion according to the interaction phase. Quantitative and qualitative evaluations show that interaction-phase-aware adaptation reduces unnecessary motion changes outside the interaction phase, while phase-aware composition improves adaptation to the target furniture while preserving the characteristics of the source motion.