Related Experiment Video
Updated: Jul 5, 2025

Capturing Representative Hand Use at Home Using Egocentric Video in Individuals with Upper Limb Impairment
Published on: December 23, 2020
A deep learning wearable-based solution for continuous at-home monitoring of upper limb goal-directed movements
Adonay S Nunes1, İlkay Yildiz Potter1, Ram Kinker Mishra1
1BioSensics LLC, Newton, MA, United States.
Introduction:
Monitoring upper limb function is crucial for tracking progress, assessing treatment effectiveness, and identifying potential problems or complications. Hand goal-directed movements (GDMs) are a crucial aspect of daily life, reflecting planned motor commands with hand trajectories towards specific target locations. Previous studies have shown that GDM tasks can detect early changes in upper limb function in neurodegenerative diseases and can be used to track disease progression over time.
Methods:
In this study, we used accelerometer data from stroke survivor participants and controls doing activities of daily living to develop an automated deep learning approach to detect GDMs. The model performance for detecting GDM or non-GDM from windowed data achieved an AUC of 0.9, accuracy 0.83, sensitivity 0.81, specificity 0.84 and F1 0.82.
Results:
We further validated the utility of detecting GDM by extracting features from GDM periods and using these features to classify whether the measurements are collected from a stroke survivor or a control participant, and to predict the Fugl-Meyer assessment score from stroke survivors.
Discussion:
This study presents a promising and reliable tool for monitoring upper limb function in a real-world setting, and assessing biomarkers related to upper limb health in neurological, neuromuscular and muscles disorders.

