Recognition of household and athletic activities using SmartShoe

The ability to provide real time feedback concerning a person's activity level and energy expenditure can be beneficial for improving activity levels of individuals. Examples include biofeedback systems used for body weight and physical activity management and biofeedback systems for rehabilitation of stroke patients. A critical aspect of any such system is being able to accurately classify data in real-time so that active and timely feedback can be provided. In the paper we demonstrate feasibility of real-time recognition of multiple household and athletic activities on a cell phone using the data collected by a wearable sensor system consisting of SmartShoe sensor and a wrist accelerometer. The experimental data were collected for multiple household and athletic activities performed by a healthy individual. The data was used to train two neural networks, one to be used primarily for sedentary individuals and one for more active individuals. Classification of household activities including ascending stairs, descending stairs, doing the dishes, vacuuming, and folding laundry, achieved 89.62% average accuracy. Classification of athletic activities such as jumping jacks, swing dancing, and ice skating, was performed with 93.13% accuracy. As proof of real-time processing on a mobile platform the trained neural network for healthy individuals was timed and required less than 4 ms to perform each feature vector construction and classification.