Inferring Mental States via Linear and Non-Linear Body Movement Dynamics: A Pilot Study

Stress, workload, and uncertainty characterize occupational tasks across sports, healthcare, military, and transportation domains. Emerging theory and empirical research suggest that coordinated whole-body movements may reflect these transient mental states. Wearable sensors and optical motion capture offer opportunities to quantify such movement dynamics and classify mental states that influence occupational performance and human-machine interaction. We tested this possibility in a small pilot study (N = 10) designed to test feasibility and identify preliminary movement features linked to mental states. Participants performed a perceptual decision-making task involving facial emotion recognition (i.e., deciding whether depicted faces were happy versus angry) with variable levels of stress (via a risk of electric shock), workload (via time pressure), and uncertainty (via visual degradation of task stimuli). The time series of movement trajectories was analyzed both holistically (full trajectory) and by phase: lowered (early), raising (middle), aiming (late), and face-to-face (sequential). For each epoch, up to 3844 linear and non-linear features were extracted across temporal, spectral, probability, divergence, and fractal domains. Features were entered into a repeated 10-fold cross-validation procedure using 80/20 train/test splits. Feature selection was conducted with the T-Rex Selector, and selected features were used to train a scikit-learn pipeline with a Robust Scaler and a Logistic Regression classifier. Models achieved mean ROC AUC scores as high as 0.76 for stress classification, with the highest sensitivity during the full movement trajectory and middle (raise) phases. Classification of workload and uncertainty states was less successful. These findings demonstrate the potential of movement-based sensing to infer stress states in applied settings and inform future human-machine interface development.