Related Experiment Video
Updated: Jun 27, 2025
Assessing the Accuracy of Fitness Smartwatch Data for Cardiovascular and Physical Activity Monitoring: A Validation Study in Digital Health
Published on: February 21, 2025
Development and validation of a smartwatch algorithm for differentiating physical activity intensity in health
Daixi Chen1,2, Yuchen Du2, Yuan Liu3
1Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, National Clinical Research Center for Eye Diseases, Center of Eye Shanghai Key Laboratory of Ocular Fundus Diseases, Shanghai Engineering Center for Visual Science and Photomedicine, Shanghai, 200080, China.
Abstract:
To develop and validate a machine learning based algorithm to estimate physical activity (PA) intensity using the smartwatch with the capacity to record PA and determine outdoor state. Two groups of participants, including 24 adults (13 males) and 18 children (9 boys), completed a sequential activity trial. During each trial, participants wore a smartwatch, and energy expenditure was measured using indirect calorimetry as gold standard. The support vector machine algorithm and the least squares regression model were applied for the metabolic equivalent (MET) estimation using raw data derived from the smartwatch. Exercise intensity was categorized based on MET values into sedentary activity (SED), light activity (LPA), moderate activity (MPA), and vigorous activity (VPA). The classification accuracy was evaluated using area under the ROC curve (AUC). The METs estimation accuracy were assessed via the mean absolute error (MAE), the correlation coefficient, Bland-Altman plots, and intraclass correlation (ICC). A total of 24 adults aged 21-34 years and 18 children aged 9-13 years participated in the study, yielding 1790 and 1246 data points for adults and children respectively for model building and validation. For adults, the AUC for classifying SED, MVPA, and VPA were 0.96, 0.88, and 0.86, respectively. The MAE between true METs and estimated METs was 0.75 METs. The correlation coefficient and ICC were 0.87 (p < 0.001) and 0.89, respectively. For children, comparable levels of accuracy were demonstrated, with the AUC for SED, MVPA, and VPA being 0.98, 0.89, and 0.85, respectively. The MAE between true METs and estimated METs was 0.80 METs. The correlation coefficient and ICC were 0.79 (p < 0.001) and 0.84, respectively. The developed model successfully estimated PA intensity with high accuracy in both adults and children. The application of this model enables independent investigation of PA intensity, facilitating research in health monitoring and potentially in areas such as myopia prevention and control.
