Related Experiment Video
Updated: May 2, 2026
Evaluation of a Smartphone-based Human Activity Recognition System in a Daily Living Environment
Published on: December 11, 2015
Developing Methods for Assessing Mental Activity Using Human-Smartphone Interactions: Comparative Analysis of
Hung-Hsun Chen1,2, Chen Lin3, Hsiang-Chih Chang3,4
1Department of Mathematics, Fu Jen Catholic University, Taipei, Taiwan.
Background:
Human biological rhythms are commonly assessed through physical activity (PA) measurement, but mental activity may offer a more substantial reflection of human biological rhythms.
Objective:
This study proposes a novel approach based on human-smartphone interaction to compute mental activity, encompassing general mental activity (GMA) and working mental activity (WMA).
Methods:
A total of 24 health care professionals participated, wearing wrist actigraphy devices and using the "Staff Hours" app for more than 457 person-days, including 332 workdays and 125 nonworkdays. PA was measured using actigraphy, while GMA and WMA were assessed based on patterns of smartphone interactions. To model WMA, machine learning techniques such as extreme gradient boosting and convolutional neural networks were applied, using human-smartphone interaction patterns and GPS-defined work hours. The data were organized by date and divided into person-days, with an 80:20 split for training and testing data sets to minimize overfitting and maximize model robustness. The study also adopted the M10 metric to quantify daily activity levels by calculating the average acceleration during the 10-hour period of highest activity each day, which facilitated the assessment of the interrelations between PA, GMA, and WMA and sleep indicators. Phase differences, such as those between PA and GMA, were defined using a second-order Butterworth filter and Hilbert transform to extract and calculate circadian rhythms and instantaneous phases. This calculation involved subtracting the phase of the reference signal from that of the target signal and averaging these differences to provide a stable and clear measure of the phase relationship between the signals. Additionally, multilevel modeling explored associations between sleep indicators (total sleep time, midpoint of sleep) and next-day activity levels, accounting for the data's nested structure.
Results:
Significant differences in activity levels were noted between workdays and nonworkdays, with WMA occurring approximately 1.08 hours earlier than PA during workdays (P<.001). Conversely, GMA was observed to commence about 1.22 hours later than PA (P<.001). Furthermore, a significant negative correlation was identified between the activity level of WMA and the previous night's midpoint of sleep (β=-0.263, P<.001), indicating that later bedtimes and wake times were linked to reduced activity levels in WMA the following day. However, there was no significant correlation between WMA's activity levels and total sleep time. Similarly, no significant correlations were found between the activity levels of PA and GMA and sleep indicators from the previous night.
Conclusions:
This study significantly advances the understanding of human biological rhythms by developing and highlighting GMA and WMA as key indicators, derived from human-smartphone interactions. These findings offer novel insights into how mental activities, alongside PA, are intricately linked to sleep patterns, emphasizing the potential of GMA and WMA in behavioral and health studies.
